2026-02-13T01:15:02.241 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T01:15:02.260 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:15:02.344 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47443' kernel: client: branch: testing sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 781/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLS1Z5ZBeBeGd9kkWVisw0B7epFY7Btu+ng1jpPV8F0u9eL5MTkCm1+WZkztB+QBeTBdjcy+pQbW0vAAdjR0Bxk= trial134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/JXqAbMmSml+h73oWE7KTTMSvPaElbqiWiap8xnNIwjFQEIrlWwAQcVHOpFT4rzo8LWxZsQIOAhJMgrTjKxUQ= trial187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuqxsNawUuuBd6myK6C68BwB4QLnqznpJFW+WbE8yTO5ctB9Lv2J6x6WejGY3jSqkD51loxUoXPja5GAGCQIEQ= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:09:17 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T01:15:02.344 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-13T01:15:02.344 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-13T01:15:02.344 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T01:15:02.345 INFO:teuthology.task.internal:Checking packages... 2026-02-13T01:15:02.345 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T01:15:02.346 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T01:15:02.346 INFO:teuthology.packaging:ref: None 2026-02-13T01:15:02.346 INFO:teuthology.packaging:tag: None 2026-02-13T01:15:02.346 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T01:15:02.346 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:15:02.346 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T01:15:02.462 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T01:15:02.463 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T01:15:02.475 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T01:15:02.475 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T01:15:02.489 INFO:teuthology.task.internal:Saving configuration 2026-02-13T01:15:02.508 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T01:15:02.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T01:15:02.593 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial028.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:23.761011', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLS1Z5ZBeBeGd9kkWVisw0B7epFY7Btu+ng1jpPV8F0u9eL5MTkCm1+WZkztB+QBeTBdjcy+pQbW0vAAdjR0Bxk='} 2026-02-13T01:15:02.648 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial134.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:23.762098', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/JXqAbMmSml+h73oWE7KTTMSvPaElbqiWiap8xnNIwjFQEIrlWwAQcVHOpFT4rzo8LWxZsQIOAhJMgrTjKxUQ='} 2026-02-13T01:15:02.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial187.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:23.761646', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKuqxsNawUuuBd6myK6C68BwB4QLnqznpJFW+WbE8yTO5ctB9Lv2J6x6WejGY3jSqkD51loxUoXPja5GAGCQIEQ='} 2026-02-13T01:15:02.703 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T01:15:02.714 INFO:teuthology.task.internal:roles: ubuntu@trial028.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T01:15:02.714 INFO:teuthology.task.internal:roles: ubuntu@trial134.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T01:15:02.714 INFO:teuthology.task.internal:roles: ubuntu@trial187.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T01:15:02.714 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T01:15:02.903 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d6e932cdb20>, signals=[15]) 2026-02-13T01:15:02.903 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T01:15:02.914 INFO:teuthology.task.internal:Opening connections... 2026-02-13T01:15:02.914 DEBUG:teuthology.task.internal:connecting to ubuntu@trial028.front.sepia.ceph.com 2026-02-13T01:15:02.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:02.975 DEBUG:teuthology.task.internal:connecting to ubuntu@trial134.front.sepia.ceph.com 2026-02-13T01:15:02.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:03.037 DEBUG:teuthology.task.internal:connecting to ubuntu@trial187.front.sepia.ceph.com 2026-02-13T01:15:03.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:03.098 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T01:15:03.109 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-13T01:15:03.124 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-13T01:15:03.124 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31" 2026-02-13T01:15:03.180 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:03.181 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:15:03.181 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:15:03.181 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:15:03.181 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:15:03.181 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:15:03.181 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-13T01:15:03.253 DEBUG:teuthology.orchestra.run.trial134:> uname -m 2026-02-13T01:15:03.269 INFO:teuthology.orchestra.run.trial134.stdout:x86_64 2026-02-13T01:15:03.269 DEBUG:teuthology.orchestra.run.trial134:> cat /etc/os-release 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:NAME="CentOS Stream" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:VERSION="9" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:ID="centos" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:VERSION_ID="9" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:ANSI_COLOR="0;31" 2026-02-13T01:15:03.325 INFO:teuthology.orchestra.run.trial134.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:03.326 INFO:teuthology.orchestra.run.trial134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:15:03.326 INFO:teuthology.orchestra.run.trial134.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:15:03.326 INFO:teuthology.orchestra.run.trial134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:15:03.326 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:15:03.326 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:15:03.326 INFO:teuthology.lock.ops:Updating trial134.front.sepia.ceph.com on lock server 2026-02-13T01:15:03.408 DEBUG:teuthology.orchestra.run.trial187:> uname -m 2026-02-13T01:15:03.424 INFO:teuthology.orchestra.run.trial187.stdout:x86_64 2026-02-13T01:15:03.424 DEBUG:teuthology.orchestra.run.trial187:> cat /etc/os-release 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:NAME="CentOS Stream" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:VERSION="9" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:ID="centos" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:VERSION_ID="9" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:ANSI_COLOR="0;31" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:15:03.480 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:15:03.481 INFO:teuthology.lock.ops:Updating trial187.front.sepia.ceph.com on lock server 2026-02-13T01:15:03.565 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T01:15:03.578 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T01:15:03.589 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T01:15:03.590 DEBUG:teuthology.orchestra.run.trial028:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:15:03.591 DEBUG:teuthology.orchestra.run.trial134:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:15:03.592 DEBUG:teuthology.orchestra.run.trial187:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:15:03.607 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T01:15:03.618 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T01:15:03.618 DEBUG:teuthology.orchestra.run.trial028:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:15:03.646 DEBUG:teuthology.orchestra.run.trial134:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:15:03.648 DEBUG:teuthology.orchestra.run.trial187:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:15:03.665 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T01:15:03.889 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T01:15:03.907 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'sha1': 'distro'} 2026-02-13T01:15:03.908 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2026-02-13T01:15:03.908 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2026-02-13T01:15:03.908 DEBUG:teuthology.orchestra.run.trial028:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:15:03.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:15:03.922 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-13T01:15:04.065 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T01:15:04.065 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-13T01:15:04.065 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-13T01:15:04.080 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-645.el9.x86_64 2026-02-13T01:15:04.081 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T01:15:04.081 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-13T01:15:04.081 DEBUG:teuthology.orchestra.run.trial028:> sudo yum upgrade -y linux-firmware 2026-02-13T01:15:05.154 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T01:15:21.406 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 27 MB 00:15 2026-02-13T01:15:32.310 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 932 kB/s | 7.8 MB 00:08 2026-02-13T01:15:33.507 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-13T01:15:34.174 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-13T01:15:37.336 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-13T01:15:38.417 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-13T01:15:38.418 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-13T01:15:38.418 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-13T01:15:38.418 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout: linux-firmware noarch 20260130-160.el9 baseos 610 M 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 1 Package 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 610 M 2026-02-13T01:15:38.419 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-13T01:15:58.405 INFO:teuthology.orchestra.run.trial028.stdout:linux-firmware-20260130-160.el9.noarch.rpm 31 MB/s | 610 MB 00:19 2026-02-13T01:15:58.405 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:15:58.405 INFO:teuthology.orchestra.run.trial028.stdout:Total 31 MB/s | 610 MB 00:19 2026-02-13T01:15:59.504 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-13T01:15:59.521 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-13T01:15:59.521 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-13T01:16:01.374 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-13T01:16:01.375 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-13T01:16:03.194 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: linux-firmware-20260130-160.el9.noarch 1/1 2026-02-13T01:16:05.193 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-13T01:16:05.232 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T01:16:05.256 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T01:16:05.360 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T01:16:05.360 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T01:16:05.411 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T01:16:05.411 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:16:05.411 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-13T01:16:05.411 INFO:teuthology.orchestra.run.trial028.stdout: linux-firmware-20260130-160.el9.noarch 2026-02-13T01:16:05.411 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:16:05.411 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-13T01:16:05.502 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T01:16:05.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T01:16:05.656 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-13T01:16:05.656 DEBUG:teuthology.orchestra.run.trial028:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-13T01:16:05.659 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial028.front.sepia.ceph.com to complete... 2026-02-13T01:16:12.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13 01:16:12 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-13T01:16:12.184 INFO:teuthology.orchestra.run.trial028.stderr:FINISHED --2026-02-13 01:16:12-- 2026-02-13T01:16:12.184 INFO:teuthology.orchestra.run.trial028.stderr:Total wall clock time: 6.5s 2026-02-13T01:16:12.184 INFO:teuthology.orchestra.run.trial028.stderr:Downloaded: 1 files, 370M in 6.4s (57.9 MB/s) 2026-02-13T01:16:12.188 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T01:16:12.188 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-13T01:16:13.313 INFO:teuthology.orchestra.run.trial028.stdout:Verifying... ######################################## 2026-02-13T01:16:13.341 INFO:teuthology.orchestra.run.trial028.stdout:Preparing... ######################################## 2026-02-13T01:16:13.353 INFO:teuthology.orchestra.run.trial028.stdout:Updating / installing... 2026-02-13T01:16:16.554 INFO:teuthology.orchestra.run.trial028.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-13T01:16:32.057 INFO:teuthology.orchestra.run.trial028.stderr:sed: can't read /lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac: No such file or directory 2026-02-13T01:16:32.057 INFO:teuthology.orchestra.run.trial028.stderr:Can't create '/boot/.vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566.hmac' from '/lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac'! 2026-02-13T01:17:23.249 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial028.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-13T01:17:23.249 DEBUG:teuthology.orchestra.run.trial028:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-13T01:17:23.288 INFO:teuthology.orchestra.run.trial028.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-13T01:17:23.289 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-13T01:17:23.290 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-13T01:17:23.291 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-13T01:17:23.292 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-13T01:17:23.293 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-13T01:17:23.294 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-13T01:17:23.295 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-13T01:17:23.296 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-13T01:17:23.297 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-13T01:17:23.298 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-13T01:17:23.299 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-13T01:17:23.300 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-13T01:17:23.301 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-13T01:17:23.302 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-13T01:17:23.303 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-13T01:17:23.304 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-13T01:17:23.305 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-13T01:17:23.306 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-13T01:17:23.307 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-13T01:17:23.308 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-13T01:17:23.309 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-13T01:17:23.310 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-13T01:17:23.311 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-13T01:17:23.312 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-13T01:17:23.313 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-13T01:17:23.314 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-13T01:17:23.315 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-13T01:17:23.316 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-13T01:17:23.317 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-13T01:17:23.318 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-13T01:17:23.319 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-13T01:17:23.320 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-13T01:17:23.321 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-13T01:17:23.322 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-13T01:17:23.323 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-13T01:17:23.324 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-13T01:17:23.325 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-13T01:17:23.326 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-13T01:17:23.327 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-13T01:17:23.328 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-13T01:17:23.329 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-13T01:17:23.330 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-13T01:17:23.331 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-13T01:17:23.332 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-13T01:17:23.333 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-13T01:17:23.334 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-13T01:17:23.335 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-13T01:17:23.336 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-13T01:17:23.337 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-13T01:17:23.338 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-13T01:17:23.339 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-13T01:17:23.340 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-13T01:17:23.341 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-13T01:17:23.342 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-13T01:17:23.343 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-13T01:17:23.344 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-13T01:17:23.345 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-13T01:17:23.346 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-13T01:17:23.347 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-13T01:17:23.348 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-13T01:17:23.349 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-13T01:17:23.350 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-13T01:17:23.351 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-13T01:17:23.352 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-13T01:17:23.353 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-13T01:17:23.354 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-13T01:17:23.355 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-13T01:17:23.356 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T01:17:23.358 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-13T01:17:23.358 DEBUG:teuthology.orchestra.run.trial028:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-13T01:17:23.379 INFO:teuthology.orchestra.run.trial028.stdout:postinstall scriptlet (using /bin/sh): 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:for file in vmlinuz System.map config; do 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: fi 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:done 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-13T01:17:23.380 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-13T01:17:23.380 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -qi grub2-tools 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Name : grub2-tools 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Epoch : 1 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Version : 2.06 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Release : 118.el9 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Architecture: x86_64 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Group : Unspecified 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Size : 8393909 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:License : GPLv3+ 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T01:17:23.450 INFO:teuthology.orchestra.run.trial028.stdout:Packager : builder@centos.org 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:Vendor : CentOS 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:Summary : Support tools for GRUB. 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:Description : 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:hardware devices. 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:17:23.451 INFO:teuthology.orchestra.run.trial028.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T01:17:23.452 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T01:17:23.452 INFO:teuthology.task.kernel:Updating grub on trial028 to boot 6.19.0-g8dec4b357aab 2026-02-13T01:17:23.452 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T01:17:23.515 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T01:17:23.516 DEBUG:teuthology.orchestra.run.trial028:> sudo command -v grubby && echo yes || echo no 2026-02-13T01:17:23.580 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/grubby 2026-02-13T01:17:23.581 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-13T01:17:23.582 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-13T01:17:23.646 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-13T01:17:23.647 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-13T01:17:23.721 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T01:17:23.928 INFO:teuthology.orchestra.run.trial028.stderr:Generating grub configuration file ... 2026-02-13T01:17:23.991 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T01:17:23.998 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-13T01:17:24.244 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T01:17:24.251 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T01:17:24.282 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T01:17:24.289 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T01:17:24.312 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T01:17:24.319 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T01:17:24.403 INFO:teuthology.orchestra.run.trial028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T01:17:24.411 INFO:teuthology.orchestra.run.trial028.stderr:done 2026-02-13T01:17:24.412 DEBUG:teuthology.orchestra.run.trial028:> test -d /sys/firmware/efi 2026-02-13T01:17:24.428 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T01:17:24.493 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/BOOT 2026-02-13T01:17:24.493 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/centos 2026-02-13T01:17:24.495 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T01:17:24.560 INFO:teuthology.orchestra.run.trial028.stdout:no 2026-02-13T01:17:24.561 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T01:17:24.626 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-13T01:17:24.627 DEBUG:teuthology.orchestra.run.trial028:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T01:17:24.690 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial028 2026-02-13T01:17:24.690 DEBUG:teuthology.orchestra.run.trial028:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T01:17:54.733 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-13T01:17:54.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-13T01:17:54.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:18:54.736 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T01:19:03.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-13T01:19:03.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:19:03.880 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-13T01:19:04.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-13T01:19:04.136 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-13T01:19:04.136 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-13T01:19:04.213 INFO:teuthology.orchestra.run.trial028.stdout:6.19.0-g8dec4b357aab 2026-02-13T01:19:04.213 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-13T01:19:04.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T01:19:04.213 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T01:19:05.215 DEBUG:teuthology.parallel:result is None 2026-02-13T01:19:05.215 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T01:19:05.228 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T01:19:05.228 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:19:05.230 DEBUG:teuthology.orchestra.run.trial134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:19:05.232 DEBUG:teuthology.orchestra.run.trial187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:19:05.265 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T01:19:05.276 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T01:19:05.290 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T01:19:05.290 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:19:05.309 DEBUG:teuthology.orchestra.run.trial134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:19:05.310 DEBUG:teuthology.orchestra.run.trial187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:19:05.346 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T01:19:05.361 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T01:19:05.362 DEBUG:teuthology.orchestra.run.trial134:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:19:05.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:05.382 DEBUG:teuthology.orchestra.run.trial187:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:19:05.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:05.397 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:19:05.400 DEBUG:teuthology.orchestra.run.trial134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:19:05.423 DEBUG:teuthology.orchestra.run.trial187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:19:05.448 INFO:teuthology.orchestra.run.trial134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:05.456 INFO:teuthology.orchestra.run.trial134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:05.459 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:05.463 INFO:teuthology.orchestra.run.trial187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:05.472 INFO:teuthology.orchestra.run.trial187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:05.479 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:05.482 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T01:19:05.493 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T01:19:05.494 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:19:05.496 DEBUG:teuthology.orchestra.run.trial134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:19:05.500 DEBUG:teuthology.orchestra.run.trial187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:19:05.549 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T01:19:05.561 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T01:19:05.561 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:19:05.564 DEBUG:teuthology.orchestra.run.trial134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:19:05.565 DEBUG:teuthology.orchestra.run.trial187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:19:05.598 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:05.753 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:05.809 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:05.940 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:05.995 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:19:05.996 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:19:06.049 DEBUG:teuthology.orchestra.run.trial134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:06.165 DEBUG:teuthology.orchestra.run.trial134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:06.190 DEBUG:teuthology.orchestra.run.trial134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:06.342 DEBUG:teuthology.orchestra.run.trial134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:06.367 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:19:06.367 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:19:06.431 DEBUG:teuthology.orchestra.run.trial187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:06.547 DEBUG:teuthology.orchestra.run.trial187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:06.572 DEBUG:teuthology.orchestra.run.trial187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:06.715 DEBUG:teuthology.orchestra.run.trial187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:06.739 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:19:06.740 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:19:06.803 DEBUG:teuthology.orchestra.run.trial028:> sudo service rsyslog restart 2026-02-13T01:19:06.805 DEBUG:teuthology.orchestra.run.trial134:> sudo service rsyslog restart 2026-02-13T01:19:06.807 DEBUG:teuthology.orchestra.run.trial187:> sudo service rsyslog restart 2026-02-13T01:19:06.834 INFO:teuthology.orchestra.run.trial134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:19:06.868 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:19:06.870 INFO:teuthology.orchestra.run.trial187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:19:07.335 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T01:19:07.347 INFO:teuthology.task.internal:Starting timer... 2026-02-13T01:19:07.347 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T01:19:07.367 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T01:19:07.384 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T01:19:07.384 DEBUG:teuthology.orchestra.run.trial028:> sudo service auditd rotate 2026-02-13T01:19:07.451 INFO:teuthology.orchestra.run.trial028.stdout:Rotating logs: 2026-02-13T01:19:07.454 DEBUG:teuthology.orchestra.run.trial134:> sudo service auditd rotate 2026-02-13T01:19:07.483 INFO:teuthology.orchestra.run.trial134.stdout:Rotating logs: 2026-02-13T01:19:07.485 DEBUG:teuthology.orchestra.run.trial187:> sudo service auditd rotate 2026-02-13T01:19:07.516 INFO:teuthology.orchestra.run.trial187.stdout:Rotating logs: 2026-02-13T01:19:07.518 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T01:19:07.518 DEBUG:teuthology.orchestra.run.trial028:> /usr/sbin/getenforce 2026-02-13T01:19:07.556 INFO:teuthology.orchestra.run.trial028.stdout:Permissive 2026-02-13T01:19:07.556 DEBUG:teuthology.orchestra.run.trial134:> /usr/sbin/getenforce 2026-02-13T01:19:07.574 INFO:teuthology.orchestra.run.trial134.stdout:Permissive 2026-02-13T01:19:07.575 DEBUG:teuthology.orchestra.run.trial187:> /usr/sbin/getenforce 2026-02-13T01:19:07.593 INFO:teuthology.orchestra.run.trial187.stdout:Permissive 2026-02-13T01:19:07.593 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial028.front.sepia.ceph.com': 'permissive', 'ubuntu@trial134.front.sepia.ceph.com': 'permissive', 'ubuntu@trial187.front.sepia.ceph.com': 'permissive'} 2026-02-13T01:19:07.594 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:19:07.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:07.653 DEBUG:teuthology.orchestra.run.trial134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:19:07.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:07.681 DEBUG:teuthology.orchestra.run.trial187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:19:07.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:07.708 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T01:19:07.708 DEBUG:teuthology.orchestra.run.trial028:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:19:07.765 DEBUG:teuthology.orchestra.run.trial134:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:19:07.790 DEBUG:teuthology.orchestra.run.trial187:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:19:07.815 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T01:19:07.831 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T01:19:07.840 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T01:19:07.840 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial028.front.sepia.ceph.com,trial134.front.sepia.ceph.com,trial187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T01:20:39.737 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial028.front.sepia.ceph.com'), Remote(name='ubuntu@trial134.front.sepia.ceph.com'), Remote(name='ubuntu@trial187.front.sepia.ceph.com')] 2026-02-13T01:20:39.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-13T01:20:39.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:20:39.855 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-13T01:20:39.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-13T01:20:39.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-13T01:20:39.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:20:40.053 DEBUG:teuthology.orchestra.run.trial134:> true 2026-02-13T01:20:40.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-13T01:20:40.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T01:20:40.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:20:40.225 DEBUG:teuthology.orchestra.run.trial187:> true 2026-02-13T01:20:40.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-13T01:20:40.300 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T01:20:40.314 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T01:20:40.314 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:20:40.315 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:20:40.318 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:20:40.318 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:20:40.320 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:20:40.321 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:20:40.346 INFO:teuthology.orchestra.run.trial134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:20:40.358 INFO:teuthology.orchestra.run.trial134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:20:40.368 INFO:teuthology.orchestra.run.trial187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:20:40.372 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:20:40.379 INFO:teuthology.orchestra.run.trial134.stderr:sudo: ntpd: command not found 2026-02-13T01:20:40.379 INFO:teuthology.orchestra.run.trial187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:20:40.389 INFO:teuthology.orchestra.run.trial134.stdout:506 Cannot talk to daemon 2026-02-13T01:20:40.396 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:20:40.399 INFO:teuthology.orchestra.run.trial187.stderr:sudo: ntpd: command not found 2026-02-13T01:20:40.401 INFO:teuthology.orchestra.run.trial134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:20:40.408 INFO:teuthology.orchestra.run.trial187.stdout:506 Cannot talk to daemon 2026-02-13T01:20:40.413 INFO:teuthology.orchestra.run.trial134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:20:40.420 INFO:teuthology.orchestra.run.trial187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:20:40.432 INFO:teuthology.orchestra.run.trial187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:20:40.439 INFO:teuthology.orchestra.run.trial028.stderr:sudo: ntpd: command not found 2026-02-13T01:20:40.459 INFO:teuthology.orchestra.run.trial028.stdout:506 Cannot talk to daemon 2026-02-13T01:20:40.462 INFO:teuthology.orchestra.run.trial134.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:20:40.464 INFO:teuthology.orchestra.run.trial134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:20:40.465 INFO:teuthology.orchestra.run.trial134.stdout:=============================================================================== 2026-02-13T01:20:40.478 INFO:teuthology.orchestra.run.trial187.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:20:40.482 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:20:40.498 INFO:teuthology.orchestra.run.trial187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:20:40.498 INFO:teuthology.orchestra.run.trial187.stdout:=============================================================================== 2026-02-13T01:20:40.498 INFO:teuthology.orchestra.run.trial187.stdout:^? 172-238-164-57.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.498 INFO:teuthology.orchestra.run.trial187.stdout:^? time2.beanman.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.498 INFO:teuthology.orchestra.run.trial187.stdout:^? 172-234-25-10.ip.linodeu> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.499 INFO:teuthology.orchestra.run.trial187.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.507 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:20:40.584 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:20:40.639 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:20:40.639 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-13T01:20:40.639 INFO:teuthology.orchestra.run.trial028.stdout:^? europa.ellipse.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.639 INFO:teuthology.orchestra.run.trial028.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.639 INFO:teuthology.orchestra.run.trial028.stdout:^? ntp.nexcess.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.640 INFO:teuthology.orchestra.run.trial028.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:40.642 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T01:20:40.662 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T01:20:40.663 DEBUG:teuthology.orchestra.run.trial028:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:20:40.664 DEBUG:teuthology.orchestra.run.trial134:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:20:40.664 DEBUG:teuthology.orchestra.run.trial187:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:20:40.668 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial134.front.sepia.ceph.com 2026-02-13T01:20:40.668 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:20:40.668 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:20:40.669 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial028.front.sepia.ceph.com 2026-02-13T01:20:40.669 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:20:40.669 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:20:40.670 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial187.front.sepia.ceph.com 2026-02-13T01:20:40.670 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:20:40.670 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:20:40.832 INFO:teuthology.orchestra.run.trial134.stdout:No match for argument: nvme-cli 2026-02-13T01:20:40.832 INFO:teuthology.orchestra.run.trial134.stderr:No packages marked for removal. 2026-02-13T01:20:40.834 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-13T01:20:40.835 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-13T01:20:40.835 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-13T01:20:40.835 INFO:teuthology.orchestra.run.trial187.stdout:No match for argument: nvme-cli 2026-02-13T01:20:40.835 INFO:teuthology.orchestra.run.trial187.stderr:No packages marked for removal. 2026-02-13T01:20:40.837 INFO:teuthology.orchestra.run.trial187.stdout:Dependencies resolved. 2026-02-13T01:20:40.838 INFO:teuthology.orchestra.run.trial187.stdout:Nothing to do. 2026-02-13T01:20:40.838 INFO:teuthology.orchestra.run.trial187.stdout:Complete! 2026-02-13T01:20:40.904 INFO:teuthology.orchestra.run.trial028.stdout:No match for argument: nvme-cli 2026-02-13T01:20:40.904 INFO:teuthology.orchestra.run.trial028.stderr:No packages marked for removal. 2026-02-13T01:20:40.907 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-13T01:20:40.908 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-13T01:20:40.908 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-13T01:20:41.126 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Feb 2026 01:20:01 AM UTC. 2026-02-13T01:20:41.135 INFO:teuthology.orchestra.run.trial187.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Feb 2026 01:20:11 AM UTC. 2026-02-13T01:20:41.207 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: Package Architecture Version Repository Size 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Upgrading: 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Install 6 Packages 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Upgrade 1 Package 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:20:41.208 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 2.4 M 2026-02-13T01:20:41.209 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-13T01:20:41.215 INFO:teuthology.orchestra.run.trial187.stdout:Dependencies resolved. 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout:================================================================================ 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout: Package Architecture Version Repository Size 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout:================================================================================ 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout:Installing: 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:20:41.216 INFO:teuthology.orchestra.run.trial187.stdout:Upgrading: 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:Installing dependencies: 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:Transaction Summary 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:================================================================================ 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:Install 6 Packages 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:Upgrade 1 Package 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:Total download size: 2.4 M 2026-02-13T01:20:41.217 INFO:teuthology.orchestra.run.trial187.stdout:Downloading Packages: 2026-02-13T01:20:41.332 INFO:teuthology.orchestra.run.trial134.stdout:(1/7): python3-configshell-1.1.30-1.el9.noarch. 1.1 MB/s | 72 kB 00:00 2026-02-13T01:20:41.344 INFO:teuthology.orchestra.run.trial134.stdout:(2/7): nvme-cli-2.16-1.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2026-02-13T01:20:41.367 INFO:teuthology.orchestra.run.trial134.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 2.3 MB/s | 84 kB 00:00 2026-02-13T01:20:41.372 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:42 ago on Fri 13 Feb 2026 01:19:59 AM UTC. 2026-02-13T01:20:41.377 INFO:teuthology.orchestra.run.trial134.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 4.5 MB/s | 150 kB 00:00 2026-02-13T01:20:41.402 INFO:teuthology.orchestra.run.trial134.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 4.5 MB/s | 116 kB 00:00 2026-02-13T01:20:41.407 INFO:teuthology.orchestra.run.trial134.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 21 MB/s | 837 kB 00:00 2026-02-13T01:20:41.443 INFO:teuthology.orchestra.run.trial134.stdout:(7/7): nvmetcli-0.8-3.el9.noarch.rpm 254 kB/s | 44 kB 00:00 2026-02-13T01:20:41.444 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:41.444 INFO:teuthology.orchestra.run.trial134.stdout:Total 10 MB/s | 2.4 MB 00:00 2026-02-13T01:20:41.461 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-13T01:20:41.462 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-13T01:20:41.462 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-13T01:20:41.462 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:20:41.463 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-13T01:20:41.464 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-13T01:20:41.464 INFO:teuthology.orchestra.run.trial028.stdout:Install 6 Packages 2026-02-13T01:20:41.464 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 1 Package 2026-02-13T01:20:41.464 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:20:41.464 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 2.4 M 2026-02-13T01:20:41.464 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-13T01:20:41.509 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-13T01:20:41.518 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-13T01:20:41.518 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-13T01:20:41.577 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-13T01:20:41.577 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-13T01:20:41.644 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-13T01:20:41.711 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:20:41.719 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:20:41.728 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:20:41.733 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:20:41.739 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:20:41.740 INFO:teuthology.orchestra.run.trial134.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:41.822 INFO:teuthology.orchestra.run.trial187.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 85 kB/s | 44 kB 00:00 2026-02-13T01:20:41.825 INFO:teuthology.orchestra.run.trial187.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 139 kB/s | 72 kB 00:00 2026-02-13T01:20:41.870 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:41.873 INFO:teuthology.orchestra.run.trial134.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:41.999 INFO:teuthology.orchestra.run.trial187.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 477 kB/s | 84 kB 00:00 2026-02-13T01:20:42.079 INFO:teuthology.orchestra.run.trial187.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 592 kB/s | 150 kB 00:00 2026-02-13T01:20:42.123 INFO:teuthology.orchestra.run.trial028.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 74 kB/s | 44 kB 00:00 2026-02-13T01:20:42.153 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:42.153 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:20:42.153 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:20:42.173 INFO:teuthology.orchestra.run.trial028.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 111 kB/s | 72 kB 00:00 2026-02-13T01:20:42.175 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:42.256 INFO:teuthology.orchestra.run.trial187.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 658 kB/s | 116 kB 00:00 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:20:42.391 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:20:42.392 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout:Upgraded: 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:20:42.442 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-13T01:20:42.467 INFO:teuthology.orchestra.run.trial028.stdout:(3/7): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-13T01:20:42.473 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:42.768 INFO:teuthology.orchestra.run.trial028.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 131 kB/s | 84 kB 00:00 2026-02-13T01:20:42.892 INFO:teuthology.orchestra.run.trial028.stdout:(5/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 209 kB/s | 150 kB 00:00 2026-02-13T01:20:43.032 INFO:teuthology.orchestra.run.trial187.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 811 kB/s | 837 kB 00:01 2026-02-13T01:20:43.076 INFO:teuthology.orchestra.run.trial187.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 666 kB/s | 1.2 MB 00:01 2026-02-13T01:20:43.077 INFO:teuthology.orchestra.run.trial187.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:43.077 INFO:teuthology.orchestra.run.trial187.stdout:Total 1.3 MB/s | 2.4 MB 00:01 2026-02-13T01:20:43.141 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction check 2026-02-13T01:20:43.148 INFO:teuthology.orchestra.run.trial187.stdout:Transaction check succeeded. 2026-02-13T01:20:43.148 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction test 2026-02-13T01:20:43.207 INFO:teuthology.orchestra.run.trial187.stdout:Transaction test succeeded. 2026-02-13T01:20:43.207 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction 2026-02-13T01:20:43.276 INFO:teuthology.orchestra.run.trial187.stdout: Preparing : 1/1 2026-02-13T01:20:43.343 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:20:43.350 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:20:43.359 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:20:43.364 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:20:43.369 INFO:teuthology.orchestra.run.trial028.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 929 kB/s | 837 kB 00:00 2026-02-13T01:20:43.370 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:20:43.371 INFO:teuthology.orchestra.run.trial187.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:43.460 INFO:teuthology.orchestra.run.trial028.stdout:(7/7): libnvme-1.16.1-2.el9.x86_64.rpm 168 kB/s | 116 kB 00:00 2026-02-13T01:20:43.460 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:43.460 INFO:teuthology.orchestra.run.trial028.stdout:Total 1.2 MB/s | 2.4 MB 00:01 2026-02-13T01:20:43.502 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:43.504 INFO:teuthology.orchestra.run.trial187.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:43.565 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-13T01:20:43.575 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-13T01:20:43.576 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-13T01:20:43.662 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-13T01:20:43.663 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-13T01:20:43.751 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-13T01:20:43.785 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:43.785 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:20:43.785 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:20:43.808 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:43.846 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:20:43.860 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:20:43.874 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:20:43.883 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:20:43.892 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:20:43.895 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:44.021 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:20:44.022 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout:Upgraded: 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout:Installed: 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:20:44.070 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:20:44.071 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:20:44.071 INFO:teuthology.orchestra.run.trial187.stdout:Complete! 2026-02-13T01:20:44.087 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:44.093 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:44.101 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:44.639 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:44.639 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:20:44.639 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:20:44.660 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.041 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.041 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:20:45.041 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:20:45.041 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:20:45.041 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:20:45.042 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:20:45.042 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:20:45.042 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:20:45.101 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:20:45.102 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-13T01:20:45.156 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:45.156 INFO:teuthology.run_tasks:Running task install... 2026-02-13T01:20:45.171 DEBUG:teuthology.task.install:project ceph 2026-02-13T01:20:45.171 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T01:20:45.171 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T01:20:45.171 INFO:teuthology.task.install:Using flavor: default 2026-02-13T01:20:45.180 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T01:20:45.180 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T01:20:45.181 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:20:45.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:45.184 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:20:45.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:45.186 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:20:45.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:45.425 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:20:45.425 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:20:45.433 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:20:45.433 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:20:45.435 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:20:45.435 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:20:45.627 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:20:45.627 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:20:45.627 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:20:45.629 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:20:45.629 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:20:45.629 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:20:45.639 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:20:45.639 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:20:45.640 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:20:45.657 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:20:45.657 DEBUG:teuthology.orchestra.run.trial134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:20:45.668 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:20:45.668 DEBUG:teuthology.orchestra.run.trial187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:20:45.686 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:20:45.686 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:20:45.722 DEBUG:teuthology.orchestra.run.trial134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:20:45.733 DEBUG:teuthology.orchestra.run.trial187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:20:45.783 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:20:45.796 DEBUG:teuthology.orchestra.run.trial134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:20:45.808 DEBUG:teuthology.orchestra.run.trial187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:20:45.857 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:20:45.860 INFO:teuthology.orchestra.run.trial134.stdout:check_obsoletes = 1 2026-02-13T01:20:45.862 DEBUG:teuthology.orchestra.run.trial134:> sudo yum clean all 2026-02-13T01:20:45.871 INFO:teuthology.orchestra.run.trial187.stdout:check_obsoletes = 1 2026-02-13T01:20:45.872 DEBUG:teuthology.orchestra.run.trial187:> sudo yum clean all 2026-02-13T01:20:45.926 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-13T01:20:45.929 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-13T01:20:46.022 INFO:teuthology.orchestra.run.trial134.stdout:41 files removed 2026-02-13T01:20:46.030 INFO:teuthology.orchestra.run.trial187.stdout:41 files removed 2026-02-13T01:20:46.037 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:20:46.044 DEBUG:teuthology.orchestra.run.trial187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:20:46.098 INFO:teuthology.orchestra.run.trial028.stdout:41 files removed 2026-02-13T01:20:46.116 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:20:46.310 INFO:teuthology.orchestra.run.trial134.stdout:ceph packages for x86_64 696 kB/s | 91 kB 00:00 2026-02-13T01:20:46.314 INFO:teuthology.orchestra.run.trial187.stdout:ceph packages for x86_64 690 kB/s | 91 kB 00:00 2026-02-13T01:20:46.445 INFO:teuthology.orchestra.run.trial134.stdout:ceph noarch packages 205 kB/s | 23 kB 00:00 2026-02-13T01:20:46.452 INFO:teuthology.orchestra.run.trial187.stdout:ceph noarch packages 204 kB/s | 23 kB 00:00 2026-02-13T01:20:46.478 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 700 kB/s | 91 kB 00:00 2026-02-13T01:20:46.564 INFO:teuthology.orchestra.run.trial134.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T01:20:46.572 INFO:teuthology.orchestra.run.trial187.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T01:20:46.617 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 202 kB/s | 23 kB 00:00 2026-02-13T01:20:46.749 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 18 kB/s | 2.1 kB 00:00 2026-02-13T01:20:47.274 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T01:20:47.683 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.9 MB 00:00 2026-02-13T01:20:48.883 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.9 MB 00:02 2026-02-13T01:20:50.204 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 14 MB/s | 27 MB 00:01 2026-02-13T01:20:50.355 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T01:20:52.567 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 27 MB 00:03 2026-02-13T01:20:53.110 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 29 MB/s | 7.8 MB 00:00 2026-02-13T01:20:54.044 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 7.8 MB 00:01 2026-02-13T01:20:54.163 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 20 kB 00:00 2026-02-13T01:20:54.794 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-13T01:20:55.006 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 20 kB 00:00 2026-02-13T01:20:55.585 INFO:teuthology.orchestra.run.trial187.stdout:Extra Packages for Enterprise Linux 40 MB/s | 20 MB 00:00 2026-02-13T01:20:58.704 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 7.8 MB 00:03 2026-02-13T01:20:58.855 INFO:teuthology.orchestra.run.trial187.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T01:20:59.040 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 1.9 MB/s | 50 kB 00:00 2026-02-13T01:21:00.117 INFO:teuthology.orchestra.run.trial187.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:00.118 INFO:teuthology.orchestra.run.trial187.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:00.123 INFO:teuthology.orchestra.run.trial187.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:21:00.123 INFO:teuthology.orchestra.run.trial187.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:21:00.124 INFO:teuthology.orchestra.run.trial187.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:21:00.124 INFO:teuthology.orchestra.run.trial187.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:21:00.125 INFO:teuthology.orchestra.run.trial187.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:21:00.126 INFO:teuthology.orchestra.run.trial187.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:21:00.127 INFO:teuthology.orchestra.run.trial187.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:21:00.154 INFO:teuthology.orchestra.run.trial187.stdout:Dependencies resolved. 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout:======================================================================================= 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: Package Arch Version Repository Size 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout:======================================================================================= 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout:Installing: 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:21:00.159 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:21:00.160 INFO:teuthology.orchestra.run.trial187.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:21:00.161 INFO:teuthology.orchestra.run.trial187.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout:Upgrading: 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:21:00.162 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout:Installing dependencies: 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:21:00.163 INFO:teuthology.orchestra.run.trial187.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:21:00.164 INFO:teuthology.orchestra.run.trial187.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:21:00.165 INFO:teuthology.orchestra.run.trial187.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:21:00.166 INFO:teuthology.orchestra.run.trial187.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:21:00.167 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:21:00.168 INFO:teuthology.orchestra.run.trial187.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:21:00.169 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:21:00.170 INFO:teuthology.orchestra.run.trial187.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:21:00.171 INFO:teuthology.orchestra.run.trial187.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:21:00.172 INFO:teuthology.orchestra.run.trial187.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout:Installing weak dependencies: 2026-02-13T01:21:00.173 INFO:teuthology.orchestra.run.trial187.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:21:00.174 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:00.174 INFO:teuthology.orchestra.run.trial187.stdout:Transaction Summary 2026-02-13T01:21:00.174 INFO:teuthology.orchestra.run.trial187.stdout:======================================================================================= 2026-02-13T01:21:00.174 INFO:teuthology.orchestra.run.trial187.stdout:Install 162 Packages 2026-02-13T01:21:00.174 INFO:teuthology.orchestra.run.trial187.stdout:Upgrade 11 Packages 2026-02-13T01:21:00.174 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:00.175 INFO:teuthology.orchestra.run.trial187.stdout:Total download size: 302 M 2026-02-13T01:21:00.175 INFO:teuthology.orchestra.run.trial187.stdout:Downloading Packages: 2026-02-13T01:21:00.382 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:00.382 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:00.388 INFO:teuthology.orchestra.run.trial028.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:21:00.389 INFO:teuthology.orchestra.run.trial028.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:21:00.389 INFO:teuthology.orchestra.run.trial028.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:21:00.390 INFO:teuthology.orchestra.run.trial028.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:21:00.391 INFO:teuthology.orchestra.run.trial028.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:21:00.392 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:21:00.392 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:21:00.422 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-13T01:21:00.427 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-13T01:21:00.427 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:21:00.428 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:21:00.429 INFO:teuthology.orchestra.run.trial028.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:21:00.430 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:21:00.431 INFO:teuthology.orchestra.run.trial028.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:21:00.432 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:21:00.433 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:21:00.434 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:21:00.435 INFO:teuthology.orchestra.run.trial028.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:21:00.436 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:21:00.437 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:21:00.438 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:21:00.439 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:21:00.440 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:21:00.441 INFO:teuthology.orchestra.run.trial028.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout:Install 162 Packages 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 11 Packages 2026-02-13T01:21:00.442 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:21:00.443 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 302 M 2026-02-13T01:21:00.443 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-13T01:21:00.558 INFO:teuthology.orchestra.run.trial187.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 100 kB/s | 6.5 kB 00:00 2026-02-13T01:21:00.682 INFO:teuthology.orchestra.run.trial187.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 7.8 MB/s | 987 kB 00:00 2026-02-13T01:21:00.729 INFO:teuthology.orchestra.run.trial187.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 3.0 MB/s | 147 kB 00:00 2026-02-13T01:21:00.767 INFO:teuthology.orchestra.run.trial187.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 19 MB/s | 5.2 MB 00:00 2026-02-13T01:21:00.818 INFO:teuthology.orchestra.run.trial187.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 18 MB/s | 940 kB 00:00 2026-02-13T01:21:00.933 INFO:teuthology.orchestra.run.trial187.stdout:(6/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 12 MB/s | 2.4 MB 00:00 2026-02-13T01:21:00.991 INFO:teuthology.orchestra.run.trial187.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 2.8 MB/s | 166 kB 00:00 2026-02-13T01:21:01.033 INFO:teuthology.orchestra.run.trial187.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 23 MB/s | 5.0 MB 00:00 2026-02-13T01:21:01.211 INFO:teuthology.orchestra.run.trial028.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2026-02-13T01:21:01.710 INFO:teuthology.orchestra.run.trial187.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 20 MB/s | 24 MB 00:01 2026-02-13T01:21:01.917 INFO:teuthology.orchestra.run.trial187.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 22 MB/s | 19 MB 00:00 2026-02-13T01:21:01.956 INFO:teuthology.orchestra.run.trial187.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 636 kB/s | 25 kB 00:00 2026-02-13T01:21:02.082 INFO:teuthology.orchestra.run.trial028.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.1 MB/s | 987 kB 00:00 2026-02-13T01:21:02.222 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - Extras packages 7.2 kB/s | 20 kB 00:02 2026-02-13T01:21:02.263 INFO:teuthology.orchestra.run.trial028.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 814 kB/s | 147 kB 00:00 2026-02-13T01:21:02.569 INFO:teuthology.orchestra.run.trial187.stdout:(12/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 15 MB/s | 13 MB 00:00 2026-02-13T01:21:02.628 INFO:teuthology.orchestra.run.trial187.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.0 MB/s | 243 kB 00:00 2026-02-13T01:21:02.684 INFO:teuthology.orchestra.run.trial187.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 482 kB/s | 27 kB 00:00 2026-02-13T01:21:02.743 INFO:teuthology.orchestra.run.trial187.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 633 kB/s | 37 kB 00:00 2026-02-13T01:21:02.770 INFO:teuthology.orchestra.run.trial187.stdout:(16/173): ceph-osd-classic-20.3.0-5241.g8f8d382 8.8 MB/s | 16 MB 00:01 2026-02-13T01:21:02.800 INFO:teuthology.orchestra.run.trial187.stdout:(17/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 430 kB/s | 24 kB 00:00 2026-02-13T01:21:02.865 INFO:teuthology.orchestra.run.trial187.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 2.4 MB/s | 159 kB 00:00 2026-02-13T01:21:02.898 INFO:teuthology.orchestra.run.trial187.stdout:(19/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 7.0 MB/s | 909 kB 00:00 2026-02-13T01:21:02.928 INFO:teuthology.orchestra.run.trial187.stdout:(20/173): librados-devel-20.3.0-5241.g8f8d3829. 1.9 MB/s | 123 kB 00:00 2026-02-13T01:21:02.966 INFO:teuthology.orchestra.run.trial187.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 3.5 MB/s | 248 kB 00:00 2026-02-13T01:21:03.034 INFO:teuthology.orchestra.run.trial187.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 668 kB/s | 45 kB 00:00 2026-02-13T01:21:03.101 INFO:teuthology.orchestra.run.trial187.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 2.7 MB/s | 185 kB 00:00 2026-02-13T01:21:03.164 INFO:teuthology.orchestra.run.trial187.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 3.2 MB/s | 204 kB 00:00 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial187.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 4.5 MB/s | 324 kB 00:00 2026-02-13T01:21:03.299 INFO:teuthology.orchestra.run.trial187.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 4.7 MB/s | 306 kB 00:00 2026-02-13T01:21:03.346 INFO:teuthology.orchestra.run.trial187.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.1 MB/s | 100 kB 00:00 2026-02-13T01:21:03.390 INFO:teuthology.orchestra.run.trial187.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.9 MB/s | 84 kB 00:00 2026-02-13T01:21:03.890 INFO:teuthology.orchestra.run.trial187.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 6.7 MB/s | 6.5 MB 00:00 2026-02-13T01:21:03.948 INFO:teuthology.orchestra.run.trial187.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 2.9 MB/s | 172 kB 00:00 2026-02-13T01:21:04.002 INFO:teuthology.orchestra.run.trial187.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.0 MB/s | 57 kB 00:00 2026-02-13T01:21:04.061 INFO:teuthology.orchestra.run.trial187.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 3.1 MB/s | 183 kB 00:00 2026-02-13T01:21:04.087 INFO:teuthology.orchestra.run.trial187.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 4.1 MB/s | 2.9 MB 00:00 2026-02-13T01:21:04.111 INFO:teuthology.orchestra.run.trial028.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 1.3 MB/s | 2.4 MB 00:01 2026-02-13T01:21:04.424 INFO:teuthology.orchestra.run.trial028.stdout:(5/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 7.0 MB/s | 24 MB 00:03 2026-02-13T01:21:04.789 INFO:teuthology.orchestra.run.trial028.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 1.4 MB/s | 940 kB 00:00 2026-02-13T01:21:04.918 INFO:teuthology.orchestra.run.trial028.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 1.3 MB/s | 166 kB 00:00 2026-02-13T01:21:06.078 INFO:teuthology.orchestra.run.trial028.stdout:(8/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 1.0 MB/s | 5.2 MB 00:05 2026-02-13T01:21:06.178 INFO:teuthology.orchestra.run.trial187.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 3.5 MB/s | 7.4 MB 00:02 2026-02-13T01:21:06.310 INFO:teuthology.orchestra.run.trial187.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 2.2 MB/s | 297 kB 00:00 2026-02-13T01:21:06.374 INFO:teuthology.orchestra.run.trial187.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 779 kB/s | 50 kB 00:00 2026-02-13T01:21:06.438 INFO:teuthology.orchestra.run.trial187.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 270 kB/s | 17 kB 00:00 2026-02-13T01:21:06.550 INFO:teuthology.orchestra.run.trial187.stdout:(38/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 6.0 MB/s | 15 MB 00:02 2026-02-13T01:21:06.569 INFO:teuthology.orchestra.run.trial187.stdout:(39/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 2.2 MB/s | 299 kB 00:00 2026-02-13T01:21:06.632 INFO:teuthology.orchestra.run.trial187.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 290 kB/s | 18 kB 00:00 2026-02-13T01:21:06.640 INFO:teuthology.orchestra.run.trial028.stdout:(9/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 2.2 MB/s | 5.0 MB 00:02 2026-02-13T01:21:06.688 INFO:teuthology.orchestra.run.trial187.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 6.1 MB/s | 350 kB 00:00 2026-02-13T01:21:06.722 INFO:teuthology.orchestra.run.trial187.stdout:(42/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 62 MB/s | 2.1 MB 00:00 2026-02-13T01:21:06.730 INFO:teuthology.orchestra.run.trial187.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.7 MB/s | 40 kB 00:00 2026-02-13T01:21:06.738 INFO:teuthology.orchestra.run.trial187.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 2.8 MB/s | 23 kB 00:00 2026-02-13T01:21:06.747 INFO:teuthology.orchestra.run.trial187.stdout:(45/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 5.2 MB/s | 1.0 MB 00:00 2026-02-13T01:21:06.747 INFO:teuthology.orchestra.run.trial187.stdout:(46/173): libconfig-1.7.2-9.el9.x86_64.rpm 7.6 MB/s | 72 kB 00:00 2026-02-13T01:21:06.757 INFO:teuthology.orchestra.run.trial187.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 18 MB/s | 184 kB 00:00 2026-02-13T01:21:06.767 INFO:teuthology.orchestra.run.trial187.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.9 MB/s | 94 kB 00:00 2026-02-13T01:21:06.775 INFO:teuthology.orchestra.run.trial187.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 4.0 MB/s | 33 kB 00:00 2026-02-13T01:21:06.784 INFO:teuthology.orchestra.run.trial187.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 10 MB/s | 93 kB 00:00 2026-02-13T01:21:06.795 INFO:teuthology.orchestra.run.trial187.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-13T01:21:06.806 INFO:teuthology.orchestra.run.trial187.stdout:(52/173): libgfortran-11.5.0-14.el9.x86_64.rpm 13 MB/s | 794 kB 00:00 2026-02-13T01:21:06.816 INFO:teuthology.orchestra.run.trial187.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 11 MB/s | 106 kB 00:00 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial187.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 15 MB/s | 135 kB 00:00 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial187.stdout:(55/173): python3-cryptography-36.0.1-5.el9.x86 38 MB/s | 1.2 MB 00:00 2026-02-13T01:21:06.835 INFO:teuthology.orchestra.run.trial187.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 12 MB/s | 126 kB 00:00 2026-02-13T01:21:06.839 INFO:teuthology.orchestra.run.trial187.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 20 MB/s | 218 kB 00:00 2026-02-13T01:21:06.843 INFO:teuthology.orchestra.run.trial187.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 21 MB/s | 182 kB 00:00 2026-02-13T01:21:06.851 INFO:teuthology.orchestra.run.trial187.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 21 MB/s | 266 kB 00:00 2026-02-13T01:21:06.856 INFO:teuthology.orchestra.run.trial187.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 56 MB/s | 689 kB 00:00 2026-02-13T01:21:06.864 INFO:teuthology.orchestra.run.trial187.stdout:(61/173): bison-3.7.4-5.el9.x86_64.rpm 76 MB/s | 943 kB 00:00 2026-02-13T01:21:06.865 INFO:teuthology.orchestra.run.trial187.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 11 MB/s | 104 kB 00:00 2026-02-13T01:21:06.873 INFO:teuthology.orchestra.run.trial187.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 8.7 MB/s | 79 kB 00:00 2026-02-13T01:21:06.874 INFO:teuthology.orchestra.run.trial187.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 34 MB/s | 313 kB 00:00 2026-02-13T01:21:06.881 INFO:teuthology.orchestra.run.trial187.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 33 kB 00:00 2026-02-13T01:21:06.889 INFO:teuthology.orchestra.run.trial187.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 2.3 MB/s | 18 kB 00:00 2026-02-13T01:21:06.897 INFO:teuthology.orchestra.run.trial187.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 1.4 MB/s | 11 kB 00:00 2026-02-13T01:21:06.907 INFO:teuthology.orchestra.run.trial187.stdout:(68/173): libnbd-1.20.3-4.el9.x86_64.rpm 16 MB/s | 164 kB 00:00 2026-02-13T01:21:06.917 INFO:teuthology.orchestra.run.trial187.stdout:(69/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 16 MB/s | 160 kB 00:00 2026-02-13T01:21:06.925 INFO:teuthology.orchestra.run.trial187.stdout:(70/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 5.3 MB/s | 45 kB 00:00 2026-02-13T01:21:06.936 INFO:teuthology.orchestra.run.trial187.stdout:(71/173): librdkafka-1.6.1-102.el9.x86_64.rpm 61 MB/s | 662 kB 00:00 2026-02-13T01:21:06.942 INFO:teuthology.orchestra.run.trial187.stdout:(72/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 44 MB/s | 3.0 MB 00:00 2026-02-13T01:21:06.946 INFO:teuthology.orchestra.run.trial187.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 24 MB/s | 246 kB 00:00 2026-02-13T01:21:06.955 INFO:teuthology.orchestra.run.trial187.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 46 MB/s | 581 kB 00:00 2026-02-13T01:21:06.955 INFO:teuthology.orchestra.run.trial187.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 2.6 MB/s | 25 kB 00:00 2026-02-13T01:21:06.964 INFO:teuthology.orchestra.run.trial187.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 6.0 MB/s | 51 kB 00:00 2026-02-13T01:21:06.965 INFO:teuthology.orchestra.run.trial187.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 23 MB/s | 233 kB 00:00 2026-02-13T01:21:06.975 INFO:teuthology.orchestra.run.trial187.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 18 MB/s | 188 kB 00:00 2026-02-13T01:21:06.977 INFO:teuthology.orchestra.run.trial187.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 22 MB/s | 292 kB 00:00 2026-02-13T01:21:06.983 INFO:teuthology.orchestra.run.trial187.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 5.0 MB/s | 42 kB 00:00 2026-02-13T01:21:07.005 INFO:teuthology.orchestra.run.trial187.stdout:(81/173): openblas-openmp-0.3.29-1.el9.x86_64.r 188 MB/s | 5.3 MB 00:00 2026-02-13T01:21:07.014 INFO:teuthology.orchestra.run.trial187.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 2.6 MB/s | 22 kB 00:00 2026-02-13T01:21:07.019 INFO:teuthology.orchestra.run.trial187.stdout:(83/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 136 MB/s | 4.8 MB 00:00 2026-02-13T01:21:07.022 INFO:teuthology.orchestra.run.trial187.stdout:(84/173): perl-threads-2.25-460.el9.x86_64.rpm 6.7 MB/s | 58 kB 00:00 2026-02-13T01:21:07.028 INFO:teuthology.orchestra.run.trial187.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 5.1 MB/s | 45 kB 00:00 2026-02-13T01:21:07.035 INFO:teuthology.orchestra.run.trial187.stdout:(86/173): postgresql-13.23-1.el9.x86_64.rpm 128 MB/s | 1.6 MB 00:00 2026-02-13T01:21:07.040 INFO:teuthology.orchestra.run.trial187.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 72 MB/s | 903 kB 00:00 2026-02-13T01:21:07.045 INFO:teuthology.orchestra.run.trial187.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 14 MB/s | 138 kB 00:00 2026-02-13T01:21:07.068 INFO:teuthology.orchestra.run.trial187.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 43 MB/s | 1.0 MB 00:00 2026-02-13T01:21:07.077 INFO:teuthology.orchestra.run.trial187.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 157 MB/s | 5.8 MB 00:00 2026-02-13T01:21:07.086 INFO:teuthology.orchestra.run.trial187.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 6.6 MB/s | 61 kB 00:00 2026-02-13T01:21:07.096 INFO:teuthology.orchestra.run.trial187.stdout:(92/173): python3-devel-3.9.25-2.el9.x86_64.rpm 24 MB/s | 244 kB 00:00 2026-02-13T01:21:07.111 INFO:teuthology.orchestra.run.trial187.stdout:(93/173): python3-babel-2.9.1-2.el9.noarch.rpm 140 MB/s | 6.0 MB 00:00 2026-02-13T01:21:07.112 INFO:teuthology.orchestra.run.trial187.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 15 MB/s | 249 kB 00:00 2026-02-13T01:21:07.120 INFO:teuthology.orchestra.run.trial187.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 5.3 MB/s | 48 kB 00:00 2026-02-13T01:21:07.122 INFO:teuthology.orchestra.run.trial187.stdout:(96/173): python3-libstoragemgmt-1.10.1-1.el9.x 17 MB/s | 177 kB 00:00 2026-02-13T01:21:07.128 INFO:teuthology.orchestra.run.trial187.stdout:(97/173): python3-markupsafe-1.1.1-12.el9.x86_6 4.0 MB/s | 35 kB 00:00 2026-02-13T01:21:07.151 INFO:teuthology.orchestra.run.trial187.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 19 MB/s | 442 kB 00:00 2026-02-13T01:21:07.163 INFO:teuthology.orchestra.run.trial187.stdout:(99/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 150 MB/s | 6.1 MB 00:00 2026-02-13T01:21:07.164 INFO:teuthology.orchestra.run.trial187.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 5.9 MB/s | 77 kB 00:00 2026-02-13T01:21:07.173 INFO:teuthology.orchestra.run.trial187.stdout:(101/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 16 MB/s | 159 kB 00:00 2026-02-13T01:21:07.177 INFO:teuthology.orchestra.run.trial187.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 19 MB/s | 267 kB 00:00 2026-02-13T01:21:07.184 INFO:teuthology.orchestra.run.trial187.stdout:(103/173): python3-pyasn1-modules-0.4.8-6.el9.n 25 MB/s | 279 kB 00:00 2026-02-13T01:21:07.186 INFO:teuthology.orchestra.run.trial187.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 5.8 MB/s | 54 kB 00:00 2026-02-13T01:21:07.195 INFO:teuthology.orchestra.run.trial187.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 4.6 MB/s | 42 kB 00:00 2026-02-13T01:21:07.204 INFO:teuthology.orchestra.run.trial187.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 4.9 MB/s | 44 kB 00:00 2026-02-13T01:21:07.215 INFO:teuthology.orchestra.run.trial187.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 22 MB/s | 240 kB 00:00 2026-02-13T01:21:07.223 INFO:teuthology.orchestra.run.trial187.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 4.4 MB/s | 37 kB 00:00 2026-02-13T01:21:07.232 INFO:teuthology.orchestra.run.trial187.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.5 MB/s | 66 kB 00:00 2026-02-13T01:21:07.242 INFO:teuthology.orchestra.run.trial187.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 28 MB/s | 303 kB 00:00 2026-02-13T01:21:07.251 INFO:teuthology.orchestra.run.trial187.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 6.6 MB/s | 58 kB 00:00 2026-02-13T01:21:07.280 INFO:teuthology.orchestra.run.trial187.stdout:(112/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 201 MB/s | 19 MB 00:00 2026-02-13T01:21:07.281 INFO:teuthology.orchestra.run.trial187.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.2 MB/s | 96 kB 00:00 2026-02-13T01:21:07.289 INFO:teuthology.orchestra.run.trial187.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.0 MB/s | 64 kB 00:00 2026-02-13T01:21:07.290 INFO:teuthology.orchestra.run.trial187.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 5.0 MB/s | 45 kB 00:00 2026-02-13T01:21:07.354 INFO:teuthology.orchestra.run.trial187.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 346 kB/s | 22 kB 00:00 2026-02-13T01:21:07.418 INFO:teuthology.orchestra.run.trial187.stdout:(117/173): abseil-cpp-20211102.0-4.el9.x86_64.r 8.4 MB/s | 551 kB 00:00 2026-02-13T01:21:07.428 INFO:teuthology.orchestra.run.trial187.stdout:(118/173): gperftools-libs-2.9.1-3.el9.x86_64.r 29 MB/s | 308 kB 00:00 2026-02-13T01:21:07.436 INFO:teuthology.orchestra.run.trial187.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 2.4 MB/s | 19 kB 00:00 2026-02-13T01:21:07.446 INFO:teuthology.orchestra.run.trial187.stdout:(120/173): protobuf-compiler-3.14.0-17.el9.x86_ 5.4 MB/s | 862 kB 00:00 2026-02-13T01:21:07.474 INFO:teuthology.orchestra.run.trial187.stdout:(121/173): libarrow-9.0.0-15.el9.x86_64.rpm 118 MB/s | 4.4 MB 00:00 2026-02-13T01:21:07.474 INFO:teuthology.orchestra.run.trial187.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 887 kB/s | 25 kB 00:00 2026-02-13T01:21:07.482 INFO:teuthology.orchestra.run.trial187.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 5.9 MB/s | 49 kB 00:00 2026-02-13T01:21:07.483 INFO:teuthology.orchestra.run.trial187.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 8.0 MB/s | 67 kB 00:00 2026-02-13T01:21:07.491 INFO:teuthology.orchestra.run.trial187.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 17 MB/s | 151 kB 00:00 2026-02-13T01:21:07.495 INFO:teuthology.orchestra.run.trial187.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 67 MB/s | 838 kB 00:00 2026-02-13T01:21:07.501 INFO:teuthology.orchestra.run.trial187.stdout:(127/173): python3-asyncssh-2.13.2-5.el9.noarch 53 MB/s | 548 kB 00:00 2026-02-13T01:21:07.503 INFO:teuthology.orchestra.run.trial187.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 3.7 MB/s | 29 kB 00:00 2026-02-13T01:21:07.510 INFO:teuthology.orchestra.run.trial187.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 7.4 MB/s | 60 kB 00:00 2026-02-13T01:21:07.511 INFO:teuthology.orchestra.run.trial187.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 5.3 MB/s | 43 kB 00:00 2026-02-13T01:21:07.517 INFO:teuthology.orchestra.run.trial187.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 4.0 MB/s | 32 kB 00:00 2026-02-13T01:21:07.519 INFO:teuthology.orchestra.run.trial187.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 1.7 MB/s | 14 kB 00:00 2026-02-13T01:21:07.526 INFO:teuthology.orchestra.run.trial187.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 19 MB/s | 173 kB 00:00 2026-02-13T01:21:07.529 INFO:teuthology.orchestra.run.trial187.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 36 MB/s | 358 kB 00:00 2026-02-13T01:21:07.536 INFO:teuthology.orchestra.run.trial187.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 30 MB/s | 303 kB 00:00 2026-02-13T01:21:07.538 INFO:teuthology.orchestra.run.trial187.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 27 MB/s | 254 kB 00:00 2026-02-13T01:21:07.551 INFO:teuthology.orchestra.run.trial187.stdout:(137/173): python3-grpcio-1.46.7-10.el9.x86_64. 136 MB/s | 2.0 MB 00:00 2026-02-13T01:21:07.552 INFO:teuthology.orchestra.run.trial187.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 10 MB/s | 144 kB 00:00 2026-02-13T01:21:07.560 INFO:teuthology.orchestra.run.trial187.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 1.3 MB/s | 11 kB 00:00 2026-02-13T01:21:07.560 INFO:teuthology.orchestra.run.trial187.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 2.2 MB/s | 18 kB 00:00 2026-02-13T01:21:07.569 INFO:teuthology.orchestra.run.trial187.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 2.3 MB/s | 23 kB 00:00 2026-02-13T01:21:07.571 INFO:teuthology.orchestra.run.trial187.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 1.8 MB/s | 20 kB 00:00 2026-02-13T01:21:07.577 INFO:teuthology.orchestra.run.trial187.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 2.4 MB/s | 19 kB 00:00 2026-02-13T01:21:07.579 INFO:teuthology.orchestra.run.trial187.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 3.4 MB/s | 26 kB 00:00 2026-02-13T01:21:07.589 INFO:teuthology.orchestra.run.trial187.stdout:(145/173): python3-kubernetes-26.1.0-3.el9.noar 88 MB/s | 1.0 MB 00:00 2026-02-13T01:21:07.590 INFO:teuthology.orchestra.run.trial187.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 7.2 MB/s | 79 kB 00:00 2026-02-13T01:21:07.597 INFO:teuthology.orchestra.run.trial187.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 7.0 MB/s | 58 kB 00:00 2026-02-13T01:21:07.598 INFO:teuthology.orchestra.run.trial187.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 2.0 MB/s | 16 kB 00:00 2026-02-13T01:21:07.606 INFO:teuthology.orchestra.run.trial187.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 10 MB/s | 90 kB 00:00 2026-02-13T01:21:07.607 INFO:teuthology.orchestra.run.trial187.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 3.2 MB/s | 28 kB 00:00 2026-02-13T01:21:07.614 INFO:teuthology.orchestra.run.trial187.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 3.8 MB/s | 31 kB 00:00 2026-02-13T01:21:07.616 INFO:teuthology.orchestra.run.trial187.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 21 MB/s | 188 kB 00:00 2026-02-13T01:21:07.622 INFO:teuthology.orchestra.run.trial187.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 7.2 MB/s | 59 kB 00:00 2026-02-13T01:21:07.624 INFO:teuthology.orchestra.run.trial187.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 4.4 MB/s | 36 kB 00:00 2026-02-13T01:21:07.630 INFO:teuthology.orchestra.run.trial187.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 11 MB/s | 86 kB 00:00 2026-02-13T01:21:07.632 INFO:teuthology.orchestra.run.trial187.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 10 MB/s | 90 kB 00:00 2026-02-13T01:21:07.638 INFO:teuthology.orchestra.run.trial187.stdout:(157/173): python3-xmltodict-0.12.0-15.el9.noar 2.8 MB/s | 22 kB 00:00 2026-02-13T01:21:07.640 INFO:teuthology.orchestra.run.trial187.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 2.5 MB/s | 20 kB 00:00 2026-02-13T01:21:07.646 INFO:teuthology.orchestra.run.trial187.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 23 MB/s | 191 kB 00:00 2026-02-13T01:21:07.653 INFO:teuthology.orchestra.run.trial187.stdout:(160/173): thrift-0.15.0-4.el9.x86_64.rpm 120 MB/s | 1.6 MB 00:00 2026-02-13T01:21:07.654 INFO:teuthology.orchestra.run.trial187.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 14 MB/s | 122 kB 00:00 2026-02-13T01:21:07.851 INFO:teuthology.orchestra.run.trial187.stdout:(162/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 13 MB/s | 78 MB 00:05 2026-02-13T01:21:07.868 INFO:teuthology.orchestra.run.trial187.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 142 MB/s | 2.4 MB 00:00 2026-02-13T01:21:07.883 INFO:teuthology.orchestra.run.trial187.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 128 MB/s | 1.9 MB 00:00 2026-02-13T01:21:07.891 INFO:teuthology.orchestra.run.trial187.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 4.3 MB/s | 37 kB 00:00 2026-02-13T01:21:07.901 INFO:teuthology.orchestra.run.trial187.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 25 MB/s | 248 kB 00:00 2026-02-13T01:21:07.932 INFO:teuthology.orchestra.run.trial187.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 28 MB/s | 866 kB 00:00 2026-02-13T01:21:07.943 INFO:teuthology.orchestra.run.trial187.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 41 MB/s | 454 kB 00:00 2026-02-13T01:21:07.957 INFO:teuthology.orchestra.run.trial187.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 107 MB/s | 1.5 MB 00:00 2026-02-13T01:21:07.969 INFO:teuthology.orchestra.run.trial187.stdout:(170/173): openssl-fips-provider-3.5.5-1.el9.x8 68 MB/s | 814 kB 00:00 2026-02-13T01:21:07.985 INFO:teuthology.orchestra.run.trial187.stdout:(171/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 141 MB/s | 2.3 MB 00:00 2026-02-13T01:21:08.388 INFO:teuthology.orchestra.run.trial187.stdout:(172/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 3.8 MB/s | 2.8 MB 00:00 2026-02-13T01:21:09.840 INFO:teuthology.orchestra.run.trial187.stdout:(173/173): librados2-20.3.0-5241.g8f8d3829.el9. 1.6 MB/s | 3.5 MB 00:02 2026-02-13T01:21:09.843 INFO:teuthology.orchestra.run.trial187.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:21:09.844 INFO:teuthology.orchestra.run.trial187.stdout:Total 31 MB/s | 302 MB 00:09 2026-02-13T01:21:10.554 INFO:teuthology.orchestra.run.trial134.stdout:Extra Packages for Enterprise Linux 2.5 MB/s | 20 MB 00:08 2026-02-13T01:21:10.647 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction check 2026-02-13T01:21:10.716 INFO:teuthology.orchestra.run.trial187.stdout:Transaction check succeeded. 2026-02-13T01:21:10.716 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction test 2026-02-13T01:21:11.113 INFO:teuthology.orchestra.run.trial028.stdout:(10/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 3.0 MB/s | 13 MB 00:04 2026-02-13T01:21:11.173 INFO:teuthology.orchestra.run.trial028.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 422 kB/s | 25 kB 00:00 2026-02-13T01:21:11.806 INFO:teuthology.orchestra.run.trial187.stdout:Transaction test succeeded. 2026-02-13T01:21:11.807 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction 2026-02-13T01:21:12.873 INFO:teuthology.orchestra.run.trial028.stdout:(12/173): ceph-osd-classic-20.3.0-5241.g8f8d382 2.0 MB/s | 16 MB 00:07 2026-02-13T01:21:12.978 INFO:teuthology.orchestra.run.trial187.stdout: Preparing : 1/1 2026-02-13T01:21:12.981 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:21:12.989 INFO:teuthology.orchestra.run.trial187.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:21:12.999 INFO:teuthology.orchestra.run.trial187.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:21:13.003 INFO:teuthology.orchestra.run.trial187.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:21:13.005 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:21:13.010 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:21:13.051 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:21:13.057 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:21:13.071 INFO:teuthology.orchestra.run.trial028.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 1.2 MB/s | 243 kB 00:00 2026-02-13T01:21:13.093 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:13.096 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:13.134 INFO:teuthology.orchestra.run.trial028.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 437 kB/s | 27 kB 00:00 2026-02-13T01:21:13.198 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:13.199 INFO:teuthology.orchestra.run.trial028.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 570 kB/s | 37 kB 00:00 2026-02-13T01:21:13.202 INFO:teuthology.orchestra.run.trial187.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:21:13.232 INFO:teuthology.orchestra.run.trial187.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:21:13.253 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:21:13.264 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:21:13.266 INFO:teuthology.orchestra.run.trial028.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 369 kB/s | 24 kB 00:00 2026-02-13T01:21:13.267 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:21:13.273 INFO:teuthology.orchestra.run.trial187.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:21:13.278 INFO:teuthology.orchestra.run.trial187.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:21:13.281 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:21:13.285 INFO:teuthology.orchestra.run.trial187.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:21:13.308 INFO:teuthology.orchestra.run.trial187.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:21:13.321 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:21:13.327 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:21:13.330 INFO:teuthology.orchestra.run.trial187.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:21:13.336 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:21:13.337 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:21:13.339 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:21:13.349 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:21:13.383 INFO:teuthology.orchestra.run.trial187.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:21:13.388 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:21:13.390 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:21:13.391 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:13.416 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:13.423 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:21:13.447 INFO:teuthology.orchestra.run.trial187.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:21:13.452 INFO:teuthology.orchestra.run.trial187.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:21:13.455 INFO:teuthology.orchestra.run.trial187.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:21:13.459 INFO:teuthology.orchestra.run.trial187.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:21:13.461 INFO:teuthology.orchestra.run.trial187.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:21:13.490 INFO:teuthology.orchestra.run.trial187.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:21:13.541 INFO:teuthology.orchestra.run.trial187.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:21:13.554 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:21:13.559 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:21:13.568 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:21:13.585 INFO:teuthology.orchestra.run.trial187.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:21:13.591 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:21:13.745 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:21:13.749 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:13.788 INFO:teuthology.orchestra.run.trial134.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T01:21:13.811 INFO:teuthology.orchestra.run.trial028.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 1.6 MB/s | 909 kB 00:00 2026-02-13T01:21:13.882 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:13.883 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:13.933 INFO:teuthology.orchestra.run.trial028.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 1.3 MB/s | 159 kB 00:00 2026-02-13T01:21:13.934 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:13.935 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:13.962 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:13.965 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:21:13.972 INFO:teuthology.orchestra.run.trial187.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:21:13.975 INFO:teuthology.orchestra.run.trial187.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:21:14.035 INFO:teuthology.orchestra.run.trial187.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:21:14.049 INFO:teuthology.orchestra.run.trial187.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:21:14.056 INFO:teuthology.orchestra.run.trial028.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 1.0 MB/s | 123 kB 00:00 2026-02-13T01:21:14.057 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:21:14.058 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:14.080 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:14.081 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:14.110 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:14.117 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:21:14.126 INFO:teuthology.orchestra.run.trial187.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:21:14.138 INFO:teuthology.orchestra.run.trial187.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:21:14.195 INFO:teuthology.orchestra.run.trial187.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:21:14.226 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:21:14.232 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:21:14.235 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:21:14.249 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:21:14.254 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:21:14.256 INFO:teuthology.orchestra.run.trial028.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 1.2 MB/s | 248 kB 00:00 2026-02-13T01:21:14.259 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:21:14.270 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:21:14.275 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:21:14.283 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:21:14.288 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:21:14.296 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:21:14.336 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:21:14.661 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:21:14.671 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:21:14.675 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:21:14.680 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:21:14.685 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:21:14.691 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:21:14.693 INFO:teuthology.orchestra.run.trial187.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:21:14.694 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:21:14.723 INFO:teuthology.orchestra.run.trial187.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:21:14.766 INFO:teuthology.orchestra.run.trial187.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:21:14.769 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:21:14.773 INFO:teuthology.orchestra.run.trial187.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:21:14.779 INFO:teuthology.orchestra.run.trial187.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:21:14.807 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:21:14.813 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:21:14.817 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:21:14.823 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:21:14.826 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:21:14.833 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:21:14.837 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:21:14.865 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:21:14.874 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:21:14.880 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:21:14.887 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:21:14.921 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:21:14.932 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:21:15.051 INFO:teuthology.orchestra.run.trial134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:15.052 INFO:teuthology.orchestra.run.trial134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:15.058 INFO:teuthology.orchestra.run.trial134.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:21:15.058 INFO:teuthology.orchestra.run.trial134.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:21:15.059 INFO:teuthology.orchestra.run.trial134.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:21:15.059 INFO:teuthology.orchestra.run.trial134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:21:15.060 INFO:teuthology.orchestra.run.trial134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:21:15.061 INFO:teuthology.orchestra.run.trial134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:21:15.062 INFO:teuthology.orchestra.run.trial134.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:21:15.089 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout:======================================================================================= 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repository Size 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout:======================================================================================= 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:21:15.094 INFO:teuthology.orchestra.run.trial134.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout:Upgrading: 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:21:15.095 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:21:15.096 INFO:teuthology.orchestra.run.trial134.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:21:15.097 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:21:15.098 INFO:teuthology.orchestra.run.trial134.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:Installing weak dependencies: 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:======================================================================================= 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:Install 162 Packages 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:Upgrade 11 Packages 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 302 M 2026-02-13T01:21:15.099 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-13T01:21:15.156 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:21:15.179 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:21:15.183 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:21:15.242 INFO:teuthology.orchestra.run.trial187.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:21:15.244 INFO:teuthology.orchestra.run.trial187.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:21:15.265 INFO:teuthology.orchestra.run.trial187.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:21:15.591 INFO:teuthology.orchestra.run.trial187.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:21:15.665 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:21:15.784 INFO:teuthology.orchestra.run.trial134.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 21 kB/s | 6.5 kB 00:00 2026-02-13T01:21:16.337 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:21:16.352 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:21:16.355 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:21:16.357 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:21:16.363 INFO:teuthology.orchestra.run.trial187.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:21:16.382 INFO:teuthology.orchestra.run.trial134.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.6 MB/s | 987 kB 00:00 2026-02-13T01:21:16.449 INFO:teuthology.orchestra.run.trial134.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 2.2 MB/s | 147 kB 00:00 2026-02-13T01:21:16.648 INFO:teuthology.orchestra.run.trial187.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:21:16.649 INFO:teuthology.orchestra.run.trial187.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:16.668 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:16.669 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:21:17.291 INFO:teuthology.orchestra.run.trial134.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 2.8 MB/s | 2.4 MB 00:00 2026-02-13T01:21:17.672 INFO:teuthology.orchestra.run.trial134.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 2.4 MB/s | 940 kB 00:00 2026-02-13T01:21:17.784 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:17.787 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:17.808 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:17.823 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:21:17.839 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:21:17.915 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:21:17.924 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:21:17.947 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:21:17.977 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:21:18.028 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:21:18.034 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:21:18.038 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:21:18.042 INFO:teuthology.orchestra.run.trial187.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:21:18.044 INFO:teuthology.orchestra.run.trial187.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:21:18.045 INFO:teuthology.orchestra.run.trial187.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:18.063 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:18.314 INFO:teuthology.orchestra.run.trial187.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:21:18.318 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:18.362 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:18.362 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:21:18.362 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:21:18.362 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:18.365 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:21:18.820 INFO:teuthology.orchestra.run.trial028.stdout:(21/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 1.4 MB/s | 6.5 MB 00:04 2026-02-13T01:21:18.885 INFO:teuthology.orchestra.run.trial028.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 689 kB/s | 45 kB 00:00 2026-02-13T01:21:19.014 INFO:teuthology.orchestra.run.trial028.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 1.4 MB/s | 185 kB 00:00 2026-02-13T01:21:19.146 INFO:teuthology.orchestra.run.trial028.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 1.5 MB/s | 204 kB 00:00 2026-02-13T01:21:19.412 INFO:teuthology.orchestra.run.trial028.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 1.2 MB/s | 324 kB 00:00 2026-02-13T01:21:19.614 INFO:teuthology.orchestra.run.trial028.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 1.5 MB/s | 306 kB 00:00 2026-02-13T01:21:19.682 INFO:teuthology.orchestra.run.trial028.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.4 MB/s | 100 kB 00:00 2026-02-13T01:21:19.751 INFO:teuthology.orchestra.run.trial028.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.2 MB/s | 84 kB 00:00 2026-02-13T01:21:19.768 INFO:teuthology.orchestra.run.trial134.stdout:(6/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 2.4 MB/s | 5.0 MB 00:02 2026-02-13T01:21:19.905 INFO:teuthology.orchestra.run.trial134.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 1.2 MB/s | 166 kB 00:00 2026-02-13T01:21:20.609 INFO:teuthology.orchestra.run.trial028.stdout:(29/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 1.3 MB/s | 19 MB 00:14 2026-02-13T01:21:20.743 INFO:teuthology.orchestra.run.trial028.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 1.3 MB/s | 172 kB 00:00 2026-02-13T01:21:20.811 INFO:teuthology.orchestra.run.trial028.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 848 kB/s | 57 kB 00:00 2026-02-13T01:21:20.943 INFO:teuthology.orchestra.run.trial028.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.4 MB/s | 183 kB 00:00 2026-02-13T01:21:21.770 INFO:teuthology.orchestra.run.trial028.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 1.4 MB/s | 2.9 MB 00:02 2026-02-13T01:21:22.362 INFO:teuthology.orchestra.run.trial134.stdout:(8/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 3.5 MB/s | 24 MB 00:06 2026-02-13T01:21:22.641 INFO:teuthology.orchestra.run.trial134.stdout:(9/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 744 kB/s | 5.2 MB 00:07 2026-02-13T01:21:23.102 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:21:23.102 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /sys 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /proc 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /mnt 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /var/tmp 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /home 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /root 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout:skipping the directory /tmp 2026-02-13T01:21:23.103 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:23.206 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:21:23.229 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:21:23.229 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:23.229 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:21:23.229 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:21:23.229 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:21:23.229 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:23.444 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:21:23.466 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:21:23.466 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:23.466 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:21:23.466 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:21:23.466 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:21:23.466 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:23.472 INFO:teuthology.orchestra.run.trial187.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:21:23.474 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:21:23.493 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:21:23.493 INFO:teuthology.orchestra.run.trial187.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:21:23.493 INFO:teuthology.orchestra.run.trial187.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:21:23.493 INFO:teuthology.orchestra.run.trial187.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:21:23.493 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:23.501 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:21:23.525 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:21:23.525 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:21:23.525 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:23.562 INFO:teuthology.orchestra.run.trial187.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:21:24.190 INFO:teuthology.orchestra.run.trial187.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:21:24.960 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:21:25.023 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:21:25.025 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:21:25.040 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:21:25.040 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:25.040 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:21:25.040 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:25.050 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:21:25.074 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:21:25.074 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:25.074 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:21:25.074 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:21:25.074 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:21:25.074 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:25.136 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:21:25.138 INFO:teuthology.orchestra.run.trial187.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:21:25.147 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:21:25.171 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:21:25.172 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:21:26.740 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:21:26.747 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:21:27.203 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:21:27.204 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:21:27.265 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:21:27.307 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:21:27.308 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:21:27.329 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:21:27.329 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:27.329 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:21:27.329 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:21:27.330 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:21:27.330 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:27.341 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:21:27.351 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:21:27.911 INFO:teuthology.orchestra.run.trial028.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 1.2 MB/s | 7.4 MB 00:06 2026-02-13T01:21:27.927 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:21:27.929 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:21:27.950 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:21:27.950 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:27.950 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:21:27.950 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:21:27.951 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:21:27.951 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:27.959 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:21:27.979 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:21:27.979 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:27.979 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:21:27.979 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:27.992 INFO:teuthology.orchestra.run.trial187.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:21:28.012 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:21:28.012 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:28.013 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:21:28.013 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:21:28.013 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:21:28.013 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:28.052 INFO:teuthology.orchestra.run.trial134.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 1.9 MB/s | 16 MB 00:08 2026-02-13T01:21:28.114 INFO:teuthology.orchestra.run.trial134.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 406 kB/s | 25 kB 00:00 2026-02-13T01:21:28.138 INFO:teuthology.orchestra.run.trial187.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:21:28.158 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:21:28.159 INFO:teuthology.orchestra.run.trial187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:21:28.159 INFO:teuthology.orchestra.run.trial187.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:21:28.159 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:21:28.159 INFO:teuthology.orchestra.run.trial187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:21:28.159 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:28.218 INFO:teuthology.orchestra.run.trial028.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 968 kB/s | 297 kB 00:00 2026-02-13T01:21:28.287 INFO:teuthology.orchestra.run.trial028.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 733 kB/s | 50 kB 00:00 2026-02-13T01:21:28.352 INFO:teuthology.orchestra.run.trial028.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 268 kB/s | 17 kB 00:00 2026-02-13T01:21:28.603 INFO:teuthology.orchestra.run.trial028.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 1.2 MB/s | 299 kB 00:00 2026-02-13T01:21:29.261 INFO:teuthology.orchestra.run.trial028.stdout:(39/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 1.8 MB/s | 15 MB 00:08 2026-02-13T01:21:29.327 INFO:teuthology.orchestra.run.trial028.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 279 kB/s | 18 kB 00:00 2026-02-13T01:21:29.460 INFO:teuthology.orchestra.run.trial028.stdout:(41/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 1.2 MB/s | 1.0 MB 00:00 2026-02-13T01:21:30.132 INFO:teuthology.orchestra.run.trial028.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 435 kB/s | 350 kB 00:00 2026-02-13T01:21:30.215 INFO:teuthology.orchestra.run.trial028.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 485 kB/s | 40 kB 00:00 2026-02-13T01:21:30.260 INFO:teuthology.orchestra.run.trial134.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 2.4 MB/s | 19 MB 00:07 2026-02-13T01:21:30.300 INFO:teuthology.orchestra.run.trial028.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 271 kB/s | 23 kB 00:00 2026-02-13T01:21:30.453 INFO:teuthology.orchestra.run.trial134.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 1.2 MB/s | 243 kB 00:00 2026-02-13T01:21:30.461 INFO:teuthology.orchestra.run.trial028.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 446 kB/s | 72 kB 00:00 2026-02-13T01:21:30.519 INFO:teuthology.orchestra.run.trial134.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 409 kB/s | 27 kB 00:00 2026-02-13T01:21:30.586 INFO:teuthology.orchestra.run.trial134.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 553 kB/s | 37 kB 00:00 2026-02-13T01:21:30.650 INFO:teuthology.orchestra.run.trial134.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 388 kB/s | 24 kB 00:00 2026-02-13T01:21:31.209 INFO:teuthology.orchestra.run.trial134.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 1.6 MB/s | 909 kB 00:00 2026-02-13T01:21:31.327 INFO:teuthology.orchestra.run.trial134.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 1.3 MB/s | 159 kB 00:00 2026-02-13T01:21:31.405 INFO:teuthology.orchestra.run.trial028.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 842 kB/s | 794 kB 00:00 2026-02-13T01:21:31.449 INFO:teuthology.orchestra.run.trial134.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 1.0 MB/s | 123 kB 00:00 2026-02-13T01:21:31.635 INFO:teuthology.orchestra.run.trial134.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 1.3 MB/s | 248 kB 00:00 2026-02-13T01:21:31.641 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:21:31.645 INFO:teuthology.orchestra.run.trial028.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 767 kB/s | 184 kB 00:00 2026-02-13T01:21:31.655 INFO:teuthology.orchestra.run.trial187.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:21:31.658 INFO:teuthology.orchestra.run.trial187.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:21:31.733 INFO:teuthology.orchestra.run.trial187.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:21:31.751 INFO:teuthology.orchestra.run.trial187.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:21:31.756 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:21:31.757 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:21:31.807 INFO:teuthology.orchestra.run.trial028.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 580 kB/s | 94 kB 00:00 2026-02-13T01:21:31.876 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:21:31.880 INFO:teuthology.orchestra.run.trial187.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:21:31.891 INFO:teuthology.orchestra.run.trial028.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 397 kB/s | 33 kB 00:00 2026-02-13T01:21:31.899 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:21:31.903 INFO:teuthology.orchestra.run.trial187.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:21:31.913 INFO:teuthology.orchestra.run.trial187.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:21:31.959 INFO:teuthology.orchestra.run.trial187.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:21:32.053 INFO:teuthology.orchestra.run.trial028.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 578 kB/s | 93 kB 00:00 2026-02-13T01:21:32.285 INFO:teuthology.orchestra.run.trial134.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 1.4 MB/s | 13 MB 00:09 2026-02-13T01:21:32.349 INFO:teuthology.orchestra.run.trial134.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 703 kB/s | 45 kB 00:00 2026-02-13T01:21:32.373 INFO:teuthology.orchestra.run.trial028.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 790 kB/s | 253 kB 00:00 2026-02-13T01:21:32.416 INFO:teuthology.orchestra.run.trial187.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:21:32.440 INFO:teuthology.orchestra.run.trial187.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:21:32.442 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:21:32.445 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:21:32.447 INFO:teuthology.orchestra.run.trial187.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:21:32.456 INFO:teuthology.orchestra.run.trial187.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:21:32.481 INFO:teuthology.orchestra.run.trial134.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 1.4 MB/s | 185 kB 00:00 2026-02-13T01:21:32.483 INFO:teuthology.orchestra.run.trial187.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:21:32.485 INFO:teuthology.orchestra.run.trial187.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:21:32.487 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:21:32.491 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:21:32.491 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:21:32.505 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:21:32.506 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:21:32.519 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:21:32.520 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:21:32.522 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:21:32.523 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:21:32.530 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:21:32.530 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:21:32.612 INFO:teuthology.orchestra.run.trial134.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 1.5 MB/s | 204 kB 00:00 2026-02-13T01:21:32.621 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:21:32.624 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:21:32.627 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:21:32.628 INFO:teuthology.orchestra.run.trial187.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:21:32.635 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:21:32.642 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:21:32.666 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:21:32.803 INFO:teuthology.orchestra.run.trial134.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 1.7 MB/s | 324 kB 00:00 2026-02-13T01:21:32.995 INFO:teuthology.orchestra.run.trial134.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 1.6 MB/s | 306 kB 00:00 2026-02-13T01:21:33.060 INFO:teuthology.orchestra.run.trial134.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.5 MB/s | 100 kB 00:00 2026-02-13T01:21:33.121 INFO:teuthology.orchestra.run.trial134.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.3 MB/s | 84 kB 00:00 2026-02-13T01:21:33.137 INFO:teuthology.orchestra.run.trial028.stdout:(52/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 584 kB/s | 2.1 MB 00:03 2026-02-13T01:21:33.301 INFO:teuthology.orchestra.run.trial028.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 650 kB/s | 106 kB 00:00 2026-02-13T01:21:33.540 INFO:teuthology.orchestra.run.trial028.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 564 kB/s | 135 kB 00:00 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:21:33.634 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:21:33.635 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:21:33.636 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:21:33.637 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:21:33.638 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:21:33.639 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:21:33.640 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:21:33.641 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:21:33.642 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:21:33.643 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:21:33.644 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:21:33.645 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:21:33.646 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:21:33.647 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:21:33.648 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:21:33.700 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:21:33.700 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:33.700 INFO:teuthology.orchestra.run.trial187.stdout:Upgraded: 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:21:33.701 INFO:teuthology.orchestra.run.trial187.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout:Installed: 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.702 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial187.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:21:33.704 INFO:teuthology.orchestra.run.trial187.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.705 INFO:teuthology.orchestra.run.trial187.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:21:33.706 INFO:teuthology.orchestra.run.trial187.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:21:33.707 INFO:teuthology.orchestra.run.trial187.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:21:33.708 INFO:teuthology.orchestra.run.trial187.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:21:33.709 INFO:teuthology.orchestra.run.trial187.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:21:33.710 INFO:teuthology.orchestra.run.trial187.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:21:33.711 INFO:teuthology.orchestra.run.trial187.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:21:33.712 INFO:teuthology.orchestra.run.trial187.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:21:33.713 INFO:teuthology.orchestra.run.trial187.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:21:33.714 INFO:teuthology.orchestra.run.trial187.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:21:33.715 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:21:33.715 INFO:teuthology.orchestra.run.trial187.stdout:Complete! 2026-02-13T01:21:33.715 INFO:teuthology.orchestra.run.trial028.stdout:(55/173): python3-requests-2.25.1-10.el9.noarch 776 kB/s | 126 kB 00:00 2026-02-13T01:21:33.800 DEBUG:teuthology.parallel:result is None 2026-02-13T01:21:33.863 INFO:teuthology.orchestra.run.trial028.stdout:(56/173): python3-cryptography-36.0.1-5.el9.x86 856 kB/s | 1.2 MB 00:01 2026-02-13T01:21:34.021 INFO:teuthology.orchestra.run.trial028.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 686 kB/s | 218 kB 00:00 2026-02-13T01:21:34.103 INFO:teuthology.orchestra.run.trial028.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 759 kB/s | 182 kB 00:00 2026-02-13T01:21:34.339 INFO:teuthology.orchestra.run.trial028.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 836 kB/s | 266 kB 00:00 2026-02-13T01:21:34.539 INFO:teuthology.orchestra.run.trial134.stdout:(29/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 2.0 MB/s | 2.9 MB 00:01 2026-02-13T01:21:34.647 INFO:teuthology.orchestra.run.trial134.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 1.6 MB/s | 172 kB 00:00 2026-02-13T01:21:34.689 INFO:teuthology.orchestra.run.trial134.stdout:(31/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 2.1 MB/s | 6.5 MB 00:03 2026-02-13T01:21:34.699 INFO:teuthology.orchestra.run.trial134.stdout:(32/173): ceph-grafana-dashboards-20.3.0-5241.g 1.1 MB/s | 57 kB 00:00 2026-02-13T01:21:34.795 INFO:teuthology.orchestra.run.trial134.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.7 MB/s | 183 kB 00:00 2026-02-13T01:21:34.926 INFO:teuthology.orchestra.run.trial028.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 837 kB/s | 689 kB 00:00 2026-02-13T01:21:35.105 INFO:teuthology.orchestra.run.trial028.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 583 kB/s | 104 kB 00:00 2026-02-13T01:21:35.282 INFO:teuthology.orchestra.run.trial028.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 448 kB/s | 79 kB 00:00 2026-02-13T01:21:35.453 INFO:teuthology.orchestra.run.trial028.stdout:(63/173): bison-3.7.4-5.el9.x86_64.rpm 846 kB/s | 943 kB 00:01 2026-02-13T01:21:35.554 INFO:teuthology.orchestra.run.trial028.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 322 kB/s | 33 kB 00:00 2026-02-13T01:21:35.694 INFO:teuthology.orchestra.run.trial028.stdout:(65/173): flex-2.6.4-9.el9.x86_64.rpm 761 kB/s | 313 kB 00:00 2026-02-13T01:21:35.796 INFO:teuthology.orchestra.run.trial028.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 178 kB/s | 18 kB 00:00 2026-02-13T01:21:35.896 INFO:teuthology.orchestra.run.trial028.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 11 kB 00:00 2026-02-13T01:21:36.151 INFO:teuthology.orchestra.run.trial028.stdout:(68/173): libnbd-1.20.3-4.el9.x86_64.rpm 643 kB/s | 164 kB 00:00 2026-02-13T01:21:36.406 INFO:teuthology.orchestra.run.trial028.stdout:(69/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 627 kB/s | 160 kB 00:00 2026-02-13T01:21:36.505 INFO:teuthology.orchestra.run.trial028.stdout:(70/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 457 kB/s | 45 kB 00:00 2026-02-13T01:21:37.307 INFO:teuthology.orchestra.run.trial028.stdout:(71/173): librdkafka-1.6.1-102.el9.x86_64.rpm 826 kB/s | 662 kB 00:00 2026-02-13T01:21:37.523 INFO:teuthology.orchestra.run.trial134.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 2.7 MB/s | 7.4 MB 00:02 2026-02-13T01:21:37.641 INFO:teuthology.orchestra.run.trial028.stdout:(72/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 739 kB/s | 246 kB 00:00 2026-02-13T01:21:37.656 INFO:teuthology.orchestra.run.trial134.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 2.2 MB/s | 297 kB 00:00 2026-02-13T01:21:37.721 INFO:teuthology.orchestra.run.trial134.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 772 kB/s | 50 kB 00:00 2026-02-13T01:21:37.786 INFO:teuthology.orchestra.run.trial134.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 268 kB/s | 17 kB 00:00 2026-02-13T01:21:37.925 INFO:teuthology.orchestra.run.trial134.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 2.1 MB/s | 299 kB 00:00 2026-02-13T01:21:38.366 INFO:teuthology.orchestra.run.trial028.stdout:(73/173): libtool-2.4.6-46.el9.x86_64.rpm 801 kB/s | 581 kB 00:00 2026-02-13T01:21:38.444 INFO:teuthology.orchestra.run.trial134.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 2.0 MB/s | 1.0 MB 00:00 2026-02-13T01:21:38.465 INFO:teuthology.orchestra.run.trial028.stdout:(74/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 248 kB/s | 25 kB 00:00 2026-02-13T01:21:38.509 INFO:teuthology.orchestra.run.trial134.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 285 kB/s | 18 kB 00:00 2026-02-13T01:21:38.557 INFO:teuthology.orchestra.run.trial134.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 7.1 MB/s | 350 kB 00:00 2026-02-13T01:21:38.588 INFO:teuthology.orchestra.run.trial134.stdout:(42/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 69 MB/s | 2.1 MB 00:00 2026-02-13T01:21:38.596 INFO:teuthology.orchestra.run.trial134.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.6 MB/s | 40 kB 00:00 2026-02-13T01:21:38.605 INFO:teuthology.orchestra.run.trial134.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 2.7 MB/s | 23 kB 00:00 2026-02-13T01:21:38.614 INFO:teuthology.orchestra.run.trial134.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 7.8 MB/s | 72 kB 00:00 2026-02-13T01:21:38.626 INFO:teuthology.orchestra.run.trial134.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 65 MB/s | 794 kB 00:00 2026-02-13T01:21:38.636 INFO:teuthology.orchestra.run.trial134.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 18 MB/s | 184 kB 00:00 2026-02-13T01:21:38.646 INFO:teuthology.orchestra.run.trial134.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.5 MB/s | 94 kB 00:00 2026-02-13T01:21:38.655 INFO:teuthology.orchestra.run.trial134.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 3.7 MB/s | 33 kB 00:00 2026-02-13T01:21:38.663 INFO:teuthology.orchestra.run.trial134.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 11 MB/s | 93 kB 00:00 2026-02-13T01:21:38.674 INFO:teuthology.orchestra.run.trial134.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-13T01:21:38.747 INFO:teuthology.orchestra.run.trial134.stdout:(52/173): python3-cryptography-36.0.1-5.el9.x86 17 MB/s | 1.2 MB 00:00 2026-02-13T01:21:38.758 INFO:teuthology.orchestra.run.trial134.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 10 MB/s | 106 kB 00:00 2026-02-13T01:21:38.769 INFO:teuthology.orchestra.run.trial134.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 12 MB/s | 135 kB 00:00 2026-02-13T01:21:38.779 INFO:teuthology.orchestra.run.trial134.stdout:(55/173): python3-requests-2.25.1-10.el9.noarch 12 MB/s | 126 kB 00:00 2026-02-13T01:21:38.790 INFO:teuthology.orchestra.run.trial134.stdout:(56/173): python3-urllib3-1.26.5-7.el9.noarch.r 19 MB/s | 218 kB 00:00 2026-02-13T01:21:38.799 INFO:teuthology.orchestra.run.trial028.stdout:(75/173): libxslt-1.1.34-12.el9.x86_64.rpm 699 kB/s | 233 kB 00:00 2026-02-13T01:21:38.802 INFO:teuthology.orchestra.run.trial134.stdout:(57/173): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-13T01:21:38.812 INFO:teuthology.orchestra.run.trial134.stdout:(58/173): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-13T01:21:38.834 INFO:teuthology.orchestra.run.trial134.stdout:(59/173): automake-1.16.2-8.el9.noarch.rpm 31 MB/s | 689 kB 00:00 2026-02-13T01:21:38.853 INFO:teuthology.orchestra.run.trial134.stdout:(60/173): bison-3.7.4-5.el9.x86_64.rpm 50 MB/s | 943 kB 00:00 2026-02-13T01:21:38.863 INFO:teuthology.orchestra.run.trial134.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 11 MB/s | 104 kB 00:00 2026-02-13T01:21:38.871 INFO:teuthology.orchestra.run.trial134.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 8.9 MB/s | 79 kB 00:00 2026-02-13T01:21:38.883 INFO:teuthology.orchestra.run.trial134.stdout:(63/173): flex-2.6.4-9.el9.x86_64.rpm 28 MB/s | 313 kB 00:00 2026-02-13T01:21:38.891 INFO:teuthology.orchestra.run.trial134.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 3.6 MB/s | 33 kB 00:00 2026-02-13T01:21:38.897 INFO:teuthology.orchestra.run.trial028.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 515 kB/s | 51 kB 00:00 2026-02-13T01:21:38.922 INFO:teuthology.orchestra.run.trial134.stdout:(65/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 99 MB/s | 3.0 MB 00:00 2026-02-13T01:21:38.930 INFO:teuthology.orchestra.run.trial134.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 2.2 MB/s | 18 kB 00:00 2026-02-13T01:21:38.938 INFO:teuthology.orchestra.run.trial134.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 1.4 MB/s | 11 kB 00:00 2026-02-13T01:21:38.948 INFO:teuthology.orchestra.run.trial134.stdout:(68/173): libnbd-1.20.3-4.el9.x86_64.rpm 17 MB/s | 164 kB 00:00 2026-02-13T01:21:38.959 INFO:teuthology.orchestra.run.trial134.stdout:(69/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 15 MB/s | 160 kB 00:00 2026-02-13T01:21:38.968 INFO:teuthology.orchestra.run.trial134.stdout:(70/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 5.0 MB/s | 45 kB 00:00 2026-02-13T01:21:38.989 INFO:teuthology.orchestra.run.trial134.stdout:(71/173): librdkafka-1.6.1-102.el9.x86_64.rpm 30 MB/s | 662 kB 00:00 2026-02-13T01:21:39.000 INFO:teuthology.orchestra.run.trial134.stdout:(72/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 22 MB/s | 246 kB 00:00 2026-02-13T01:21:39.013 INFO:teuthology.orchestra.run.trial028.stdout:(77/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 885 kB/s | 3.0 MB 00:03 2026-02-13T01:21:39.019 INFO:teuthology.orchestra.run.trial134.stdout:(73/173): libtool-2.4.6-46.el9.x86_64.rpm 29 MB/s | 581 kB 00:00 2026-02-13T01:21:39.028 INFO:teuthology.orchestra.run.trial134.stdout:(74/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 2.9 MB/s | 25 kB 00:00 2026-02-13T01:21:39.038 INFO:teuthology.orchestra.run.trial134.stdout:(75/173): libxslt-1.1.34-12.el9.x86_64.rpm 22 MB/s | 233 kB 00:00 2026-02-13T01:21:39.047 INFO:teuthology.orchestra.run.trial134.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 5.7 MB/s | 51 kB 00:00 2026-02-13T01:21:39.061 INFO:teuthology.orchestra.run.trial134.stdout:(77/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 21 MB/s | 292 kB 00:00 2026-02-13T01:21:39.072 INFO:teuthology.orchestra.run.trial134.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 18 MB/s | 188 kB 00:00 2026-02-13T01:21:39.080 INFO:teuthology.orchestra.run.trial134.stdout:(79/173): openblas-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 42 kB 00:00 2026-02-13T01:21:39.197 INFO:teuthology.orchestra.run.trial134.stdout:(80/173): openblas-openmp-0.3.29-1.el9.x86_64.r 45 MB/s | 5.3 MB 00:00 2026-02-13T01:21:39.245 INFO:teuthology.orchestra.run.trial134.stdout:(81/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 100 MB/s | 4.8 MB 00:00 2026-02-13T01:21:39.254 INFO:teuthology.orchestra.run.trial134.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 2.6 MB/s | 22 kB 00:00 2026-02-13T01:21:39.263 INFO:teuthology.orchestra.run.trial134.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 6.6 MB/s | 58 kB 00:00 2026-02-13T01:21:39.270 INFO:teuthology.orchestra.run.trial028.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 735 kB/s | 188 kB 00:00 2026-02-13T01:21:39.271 INFO:teuthology.orchestra.run.trial134.stdout:(84/173): perl-threads-shared-1.61-460.el9.x86_ 5.1 MB/s | 45 kB 00:00 2026-02-13T01:21:39.290 INFO:teuthology.orchestra.run.trial134.stdout:(85/173): postgresql-13.23-1.el9.x86_64.rpm 87 MB/s | 1.6 MB 00:00 2026-02-13T01:21:39.303 INFO:teuthology.orchestra.run.trial134.stdout:(86/173): postgresql-contrib-13.23-1.el9.x86_64 67 MB/s | 903 kB 00:00 2026-02-13T01:21:39.309 INFO:teuthology.orchestra.run.trial028.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 712 kB/s | 292 kB 00:00 2026-02-13T01:21:39.313 INFO:teuthology.orchestra.run.trial134.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 13 MB/s | 138 kB 00:00 2026-02-13T01:21:39.361 INFO:teuthology.orchestra.run.trial134.stdout:(88/173): postgresql-server-13.23-1.el9.x86_64. 122 MB/s | 5.8 MB 00:00 2026-02-13T01:21:39.369 INFO:teuthology.orchestra.run.trial028.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 424 kB/s | 42 kB 00:00 2026-02-13T01:21:39.374 INFO:teuthology.orchestra.run.trial134.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 74 MB/s | 1.0 MB 00:00 2026-02-13T01:21:39.426 INFO:teuthology.orchestra.run.trial134.stdout:(90/173): python3-babel-2.9.1-2.el9.noarch.rpm 116 MB/s | 6.0 MB 00:00 2026-02-13T01:21:39.436 INFO:teuthology.orchestra.run.trial134.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 6.3 MB/s | 61 kB 00:00 2026-02-13T01:21:39.446 INFO:teuthology.orchestra.run.trial134.stdout:(92/173): python3-devel-3.9.25-2.el9.x86_64.rpm 23 MB/s | 244 kB 00:00 2026-02-13T01:21:39.457 INFO:teuthology.orchestra.run.trial134.stdout:(93/173): python3-jinja2-2.11.3-8.el9.noarch.rp 22 MB/s | 249 kB 00:00 2026-02-13T01:21:39.467 INFO:teuthology.orchestra.run.trial134.stdout:(94/173): python3-jmespath-1.0.1-1.el9.noarch.r 5.0 MB/s | 48 kB 00:00 2026-02-13T01:21:39.477 INFO:teuthology.orchestra.run.trial134.stdout:(95/173): python3-libstoragemgmt-1.10.1-1.el9.x 17 MB/s | 177 kB 00:00 2026-02-13T01:21:39.486 INFO:teuthology.orchestra.run.trial134.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 3.7 MB/s | 35 kB 00:00 2026-02-13T01:21:39.538 INFO:teuthology.orchestra.run.trial134.stdout:(97/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 119 MB/s | 6.1 MB 00:00 2026-02-13T01:21:39.550 INFO:teuthology.orchestra.run.trial134.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 35 MB/s | 442 kB 00:00 2026-02-13T01:21:39.560 INFO:teuthology.orchestra.run.trial134.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 7.6 MB/s | 77 kB 00:00 2026-02-13T01:21:39.571 INFO:teuthology.orchestra.run.trial134.stdout:(100/173): python3-protobuf-3.14.0-17.el9.noarc 26 MB/s | 267 kB 00:00 2026-02-13T01:21:39.582 INFO:teuthology.orchestra.run.trial134.stdout:(101/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 14 MB/s | 159 kB 00:00 2026-02-13T01:21:39.593 INFO:teuthology.orchestra.run.trial134.stdout:(102/173): python3-pyasn1-modules-0.4.8-6.el9.n 24 MB/s | 279 kB 00:00 2026-02-13T01:21:39.603 INFO:teuthology.orchestra.run.trial134.stdout:(103/173): python3-requests-oauthlib-1.3.0-12.e 5.6 MB/s | 54 kB 00:00 2026-02-13T01:21:39.748 INFO:teuthology.orchestra.run.trial134.stdout:(104/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 133 MB/s | 19 MB 00:00 2026-02-13T01:21:39.757 INFO:teuthology.orchestra.run.trial134.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 4.4 MB/s | 42 kB 00:00 2026-02-13T01:21:39.766 INFO:teuthology.orchestra.run.trial134.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 4.8 MB/s | 44 kB 00:00 2026-02-13T01:21:39.775 INFO:teuthology.orchestra.run.trial134.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 25 MB/s | 240 kB 00:00 2026-02-13T01:21:39.784 INFO:teuthology.orchestra.run.trial134.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 4.3 MB/s | 37 kB 00:00 2026-02-13T01:21:39.793 INFO:teuthology.orchestra.run.trial134.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.4 MB/s | 66 kB 00:00 2026-02-13T01:21:39.802 INFO:teuthology.orchestra.run.trial134.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 32 MB/s | 303 kB 00:00 2026-02-13T01:21:39.811 INFO:teuthology.orchestra.run.trial134.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 6.4 MB/s | 58 kB 00:00 2026-02-13T01:21:39.821 INFO:teuthology.orchestra.run.trial134.stdout:(112/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 10 MB/s | 96 kB 00:00 2026-02-13T01:21:39.830 INFO:teuthology.orchestra.run.trial134.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.8 MB/s | 64 kB 00:00 2026-02-13T01:21:39.839 INFO:teuthology.orchestra.run.trial134.stdout:(114/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 4.6 MB/s | 45 kB 00:00 2026-02-13T01:21:40.141 INFO:teuthology.orchestra.run.trial134.stdout:(115/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 6.5 MB/s | 78 MB 00:12 2026-02-13T01:21:40.142 INFO:teuthology.orchestra.run.trial134.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2026-02-13T01:21:40.610 INFO:teuthology.orchestra.run.trial134.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 1.8 MB/s | 862 kB 00:00 2026-02-13T01:21:40.655 INFO:teuthology.orchestra.run.trial134.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.0 MB/s | 551 kB 00:00 2026-02-13T01:21:40.828 INFO:teuthology.orchestra.run.trial028.stdout:(81/173): openblas-openmp-0.3.29-1.el9.x86_64.r 3.5 MB/s | 5.3 MB 00:01 2026-02-13T01:21:40.872 INFO:teuthology.orchestra.run.trial134.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 90 kB/s | 19 kB 00:00 2026-02-13T01:21:40.930 INFO:teuthology.orchestra.run.trial028.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 220 kB/s | 22 kB 00:00 2026-02-13T01:21:41.027 INFO:teuthology.orchestra.run.trial134.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 738 kB/s | 308 kB 00:00 2026-02-13T01:21:41.030 INFO:teuthology.orchestra.run.trial028.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 584 kB/s | 58 kB 00:00 2026-02-13T01:21:41.129 INFO:teuthology.orchestra.run.trial028.stdout:(84/173): perl-threads-shared-1.61-460.el9.x86_ 450 kB/s | 45 kB 00:00 2026-02-13T01:21:41.241 INFO:teuthology.orchestra.run.trial134.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 115 kB/s | 25 kB 00:00 2026-02-13T01:21:41.311 INFO:teuthology.orchestra.run.trial028.stdout:(85/173): postgresql-13.23-1.el9.x86_64.rpm 8.9 MB/s | 1.6 MB 00:00 2026-02-13T01:21:41.346 INFO:teuthology.orchestra.run.trial028.stdout:(86/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 2.4 MB/s | 4.8 MB 00:01 2026-02-13T01:21:41.418 INFO:teuthology.orchestra.run.trial028.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 8.3 MB/s | 903 kB 00:00 2026-02-13T01:21:41.446 INFO:teuthology.orchestra.run.trial028.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 1.4 MB/s | 138 kB 00:00 2026-02-13T01:21:41.528 INFO:teuthology.orchestra.run.trial134.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 171 kB/s | 49 kB 00:00 2026-02-13T01:21:41.590 INFO:teuthology.orchestra.run.trial134.stdout:(123/173): libarrow-9.0.0-15.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2026-02-13T01:21:41.731 INFO:teuthology.orchestra.run.trial028.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2026-02-13T01:21:41.804 INFO:teuthology.orchestra.run.trial134.stdout:(124/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d 2.1 MB/s | 15 MB 00:07 2026-02-13T01:21:41.807 INFO:teuthology.orchestra.run.trial134.stdout:(125/173): libunwind-1.6.2-1.el9.x86_64.rpm 241 kB/s | 67 kB 00:00 2026-02-13T01:21:41.845 INFO:teuthology.orchestra.run.trial028.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2026-02-13T01:21:41.946 INFO:teuthology.orchestra.run.trial028.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 612 kB/s | 61 kB 00:00 2026-02-13T01:21:41.966 INFO:teuthology.orchestra.run.trial134.stdout:(126/173): luarocks-3.9.2-5.el9.noarch.rpm 402 kB/s | 151 kB 00:00 2026-02-13T01:21:42.048 INFO:teuthology.orchestra.run.trial028.stdout:(92/173): python3-devel-3.9.25-2.el9.x86_64.rpm 2.3 MB/s | 244 kB 00:00 2026-02-13T01:21:42.149 INFO:teuthology.orchestra.run.trial028.stdout:(93/173): python3-jinja2-2.11.3-8.el9.noarch.rp 2.4 MB/s | 249 kB 00:00 2026-02-13T01:21:42.201 INFO:teuthology.orchestra.run.trial134.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 125 kB/s | 29 kB 00:00 2026-02-13T01:21:42.249 INFO:teuthology.orchestra.run.trial028.stdout:(94/173): python3-jmespath-1.0.1-1.el9.noarch.r 478 kB/s | 48 kB 00:00 2026-02-13T01:21:42.342 INFO:teuthology.orchestra.run.trial134.stdout:(128/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.5 MB/s | 838 kB 00:00 2026-02-13T01:21:42.348 INFO:teuthology.orchestra.run.trial134.stdout:(129/173): python3-asyncssh-2.13.2-5.el9.noarch 1.0 MB/s | 548 kB 00:00 2026-02-13T01:21:42.350 INFO:teuthology.orchestra.run.trial028.stdout:(95/173): python3-libstoragemgmt-1.10.1-1.el9.x 1.7 MB/s | 177 kB 00:00 2026-02-13T01:21:42.450 INFO:teuthology.orchestra.run.trial028.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2026-02-13T01:21:42.483 INFO:teuthology.orchestra.run.trial134.stdout:(130/173): python3-backports-tarfile-1.2.0-1.el 213 kB/s | 60 kB 00:00 2026-02-13T01:21:42.554 INFO:teuthology.orchestra.run.trial134.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 205 kB/s | 43 kB 00:00 2026-02-13T01:21:42.566 INFO:teuthology.orchestra.run.trial134.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 148 kB/s | 32 kB 00:00 2026-02-13T01:21:42.628 INFO:teuthology.orchestra.run.trial134.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 97 kB/s | 14 kB 00:00 2026-02-13T01:21:42.659 INFO:teuthology.orchestra.run.trial028.stdout:(97/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 29 MB/s | 6.1 MB 00:00 2026-02-13T01:21:42.699 INFO:teuthology.orchestra.run.trial028.stdout:(98/173): python3-babel-2.9.1-2.el9.noarch.rpm 6.2 MB/s | 6.0 MB 00:00 2026-02-13T01:21:42.761 INFO:teuthology.orchestra.run.trial028.stdout:(99/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 4.2 MB/s | 442 kB 00:00 2026-02-13T01:21:42.799 INFO:teuthology.orchestra.run.trial028.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 770 kB/s | 77 kB 00:00 2026-02-13T01:21:42.863 INFO:teuthology.orchestra.run.trial028.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 2.6 MB/s | 267 kB 00:00 2026-02-13T01:21:42.900 INFO:teuthology.orchestra.run.trial028.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.5 MB/s | 159 kB 00:00 2026-02-13T01:21:42.915 INFO:teuthology.orchestra.run.trial134.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 481 kB/s | 173 kB 00:00 2026-02-13T01:21:42.965 INFO:teuthology.orchestra.run.trial028.stdout:(103/173): python3-pyasn1-modules-0.4.8-6.el9.n 2.7 MB/s | 279 kB 00:00 2026-02-13T01:21:42.996 INFO:teuthology.orchestra.run.trial134.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 833 kB/s | 358 kB 00:00 2026-02-13T01:21:43.000 INFO:teuthology.orchestra.run.trial028.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 535 kB/s | 54 kB 00:00 2026-02-13T01:21:43.096 INFO:teuthology.orchestra.run.trial134.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 648 kB/s | 303 kB 00:00 2026-02-13T01:21:43.100 INFO:teuthology.orchestra.run.trial028.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 418 kB/s | 42 kB 00:00 2026-02-13T01:21:43.200 INFO:teuthology.orchestra.run.trial028.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 442 kB/s | 44 kB 00:00 2026-02-13T01:21:43.246 INFO:teuthology.orchestra.run.trial028.stdout:(107/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 69 MB/s | 19 MB 00:00 2026-02-13T01:21:43.328 INFO:teuthology.orchestra.run.trial028.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 1.8 MB/s | 240 kB 00:00 2026-02-13T01:21:43.345 INFO:teuthology.orchestra.run.trial028.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 375 kB/s | 37 kB 00:00 2026-02-13T01:21:43.355 INFO:teuthology.orchestra.run.trial134.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 578 kB/s | 254 kB 00:00 2026-02-13T01:21:43.427 INFO:teuthology.orchestra.run.trial028.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 667 kB/s | 66 kB 00:00 2026-02-13T01:21:43.466 INFO:teuthology.orchestra.run.trial028.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2026-02-13T01:21:43.473 INFO:teuthology.orchestra.run.trial134.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 384 kB/s | 144 kB 00:00 2026-02-13T01:21:43.501 INFO:teuthology.orchestra.run.trial134.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 73 kB/s | 11 kB 00:00 2026-02-13T01:21:43.544 INFO:teuthology.orchestra.run.trial028.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 494 kB/s | 58 kB 00:00 2026-02-13T01:21:43.565 INFO:teuthology.orchestra.run.trial028.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 966 kB/s | 96 kB 00:00 2026-02-13T01:21:43.643 INFO:teuthology.orchestra.run.trial028.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 643 kB/s | 64 kB 00:00 2026-02-13T01:21:43.657 INFO:teuthology.orchestra.run.trial134.stdout:(140/173): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2026-02-13T01:21:43.664 INFO:teuthology.orchestra.run.trial028.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2026-02-13T01:21:43.682 INFO:teuthology.orchestra.run.trial134.stdout:(141/173): python3-jaraco-classes-3.2.1-5.el9.n 84 kB/s | 18 kB 00:00 2026-02-13T01:21:43.727 INFO:teuthology.orchestra.run.trial134.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 102 kB/s | 23 kB 00:00 2026-02-13T01:21:43.730 INFO:teuthology.orchestra.run.trial028.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 257 kB/s | 22 kB 00:00 2026-02-13T01:21:43.828 INFO:teuthology.orchestra.run.trial028.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 5.1 MB/s | 862 kB 00:00 2026-02-13T01:21:43.887 INFO:teuthology.orchestra.run.trial134.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 85 kB/s | 20 kB 00:00 2026-02-13T01:21:43.897 INFO:teuthology.orchestra.run.trial134.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 90 kB/s | 19 kB 00:00 2026-02-13T01:21:43.960 INFO:teuthology.orchestra.run.trial134.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 113 kB/s | 26 kB 00:00 2026-02-13T01:21:43.979 INFO:teuthology.orchestra.run.trial028.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 2.2 MB/s | 551 kB 00:00 2026-02-13T01:21:44.030 INFO:teuthology.orchestra.run.trial028.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 383 kB/s | 19 kB 00:00 2026-02-13T01:21:44.031 INFO:teuthology.orchestra.run.trial028.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.5 MB/s | 308 kB 00:00 2026-02-13T01:21:44.064 INFO:teuthology.orchestra.run.trial028.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 762 kB/s | 25 kB 00:00 2026-02-13T01:21:44.099 INFO:teuthology.orchestra.run.trial028.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-13T01:21:44.135 INFO:teuthology.orchestra.run.trial028.stdout:(123/173): libunwind-1.6.2-1.el9.x86_64.rpm 1.8 MB/s | 67 kB 00:00 2026-02-13T01:21:44.170 INFO:teuthology.orchestra.run.trial028.stdout:(124/173): libarrow-9.0.0-15.el9.x86_64.rpm 32 MB/s | 4.4 MB 00:00 2026-02-13T01:21:44.189 INFO:teuthology.orchestra.run.trial134.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 270 kB/s | 79 kB 00:00 2026-02-13T01:21:44.191 INFO:teuthology.orchestra.run.trial028.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2026-02-13T01:21:44.207 INFO:teuthology.orchestra.run.trial028.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 22 MB/s | 838 kB 00:00 2026-02-13T01:21:44.249 INFO:teuthology.orchestra.run.trial028.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 696 kB/s | 29 kB 00:00 2026-02-13T01:21:44.250 INFO:teuthology.orchestra.run.trial134.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 199 kB/s | 58 kB 00:00 2026-02-13T01:21:44.280 INFO:teuthology.orchestra.run.trial028.stdout:(128/173): python3-asyncssh-2.13.2-5.el9.noarch 6.1 MB/s | 548 kB 00:00 2026-02-13T01:21:44.296 INFO:teuthology.orchestra.run.trial028.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 1.3 MB/s | 60 kB 00:00 2026-02-13T01:21:44.318 INFO:teuthology.orchestra.run.trial028.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.1 MB/s | 43 kB 00:00 2026-02-13T01:21:44.327 INFO:teuthology.orchestra.run.trial028.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2026-02-13T01:21:44.351 INFO:teuthology.orchestra.run.trial028.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 430 kB/s | 14 kB 00:00 2026-02-13T01:21:44.367 INFO:teuthology.orchestra.run.trial028.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 4.3 MB/s | 173 kB 00:00 2026-02-13T01:21:44.400 INFO:teuthology.orchestra.run.trial028.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2026-02-13T01:21:44.407 INFO:teuthology.orchestra.run.trial134.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 75 kB/s | 16 kB 00:00 2026-02-13T01:21:44.411 INFO:teuthology.orchestra.run.trial028.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.8 MB/s | 303 kB 00:00 2026-02-13T01:21:44.437 INFO:teuthology.orchestra.run.trial028.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 6.8 MB/s | 254 kB 00:00 2026-02-13T01:21:44.464 INFO:teuthology.orchestra.run.trial028.stdout:(137/173): python3-grpcio-1.46.7-10.el9.x86_64. 38 MB/s | 2.0 MB 00:00 2026-02-13T01:21:44.476 INFO:teuthology.orchestra.run.trial134.stdout:(149/173): python3-kubernetes-26.1.0-3.el9.noar 1.7 MB/s | 1.0 MB 00:00 2026-02-13T01:21:44.483 INFO:teuthology.orchestra.run.trial028.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 3.0 MB/s | 144 kB 00:00 2026-02-13T01:21:44.503 INFO:teuthology.orchestra.run.trial028.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 273 kB/s | 11 kB 00:00 2026-02-13T01:21:44.515 INFO:teuthology.orchestra.run.trial028.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 559 kB/s | 18 kB 00:00 2026-02-13T01:21:44.534 INFO:teuthology.orchestra.run.trial028.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 740 kB/s | 23 kB 00:00 2026-02-13T01:21:44.538 INFO:teuthology.orchestra.run.trial134.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 313 kB/s | 90 kB 00:00 2026-02-13T01:21:44.551 INFO:teuthology.orchestra.run.trial028.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 554 kB/s | 20 kB 00:00 2026-02-13T01:21:44.566 INFO:teuthology.orchestra.run.trial028.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 622 kB/s | 19 kB 00:00 2026-02-13T01:21:44.590 INFO:teuthology.orchestra.run.trial028.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 679 kB/s | 26 kB 00:00 2026-02-13T01:21:44.604 INFO:teuthology.orchestra.run.trial028.stdout:(145/173): python3-kubernetes-26.1.0-3.el9.noar 27 MB/s | 1.0 MB 00:00 2026-02-13T01:21:44.630 INFO:teuthology.orchestra.run.trial028.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2026-02-13T01:21:44.634 INFO:teuthology.orchestra.run.trial134.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 124 kB/s | 28 kB 00:00 2026-02-13T01:21:44.638 INFO:teuthology.orchestra.run.trial028.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2026-02-13T01:21:44.667 INFO:teuthology.orchestra.run.trial028.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 450 kB/s | 16 kB 00:00 2026-02-13T01:21:44.679 INFO:teuthology.orchestra.run.trial028.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.2 MB/s | 90 kB 00:00 2026-02-13T01:21:44.688 INFO:teuthology.orchestra.run.trial134.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 145 kB/s | 31 kB 00:00 2026-02-13T01:21:44.704 INFO:teuthology.orchestra.run.trial028.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 770 kB/s | 28 kB 00:00 2026-02-13T01:21:44.738 INFO:teuthology.orchestra.run.trial028.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 519 kB/s | 31 kB 00:00 2026-02-13T01:21:44.745 INFO:teuthology.orchestra.run.trial028.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 4.5 MB/s | 188 kB 00:00 2026-02-13T01:21:44.770 INFO:teuthology.orchestra.run.trial028.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2026-02-13T01:21:44.784 INFO:teuthology.orchestra.run.trial028.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 928 kB/s | 36 kB 00:00 2026-02-13T01:21:44.809 INFO:teuthology.orchestra.run.trial028.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 2.1 MB/s | 86 kB 00:00 2026-02-13T01:21:44.817 INFO:teuthology.orchestra.run.trial028.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2026-02-13T01:21:44.845 INFO:teuthology.orchestra.run.trial028.stdout:(157/173): python3-xmltodict-0.12.0-15.el9.noar 627 kB/s | 22 kB 00:00 2026-02-13T01:21:44.854 INFO:teuthology.orchestra.run.trial028.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 545 kB/s | 20 kB 00:00 2026-02-13T01:21:44.878 INFO:teuthology.orchestra.run.trial028.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2026-02-13T01:21:44.901 INFO:teuthology.orchestra.run.trial134.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 519 kB/s | 188 kB 00:00 2026-02-13T01:21:44.908 INFO:teuthology.orchestra.run.trial134.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 163 kB/s | 36 kB 00:00 2026-02-13T01:21:44.915 INFO:teuthology.orchestra.run.trial134.stdout:(155/173): python3-rsa-4.9-2.el9.noarch.rpm 210 kB/s | 59 kB 00:00 2026-02-13T01:21:44.921 INFO:teuthology.orchestra.run.trial028.stdout:(160/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.8 MB/s | 122 kB 00:00 2026-02-13T01:21:44.926 INFO:teuthology.orchestra.run.trial028.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 22 MB/s | 1.6 MB 00:00 2026-02-13T01:21:45.133 INFO:teuthology.orchestra.run.trial134.stdout:(156/173): python3-xmltodict-0.12.0-15.el9.noar 102 kB/s | 22 kB 00:00 2026-02-13T01:21:45.182 INFO:teuthology.orchestra.run.trial134.stdout:(157/173): python3-typing-extensions-4.15.0-1.e 307 kB/s | 86 kB 00:00 2026-02-13T01:21:45.187 INFO:teuthology.orchestra.run.trial134.stdout:(158/173): python3-websocket-client-1.2.3-2.el9 321 kB/s | 90 kB 00:00 2026-02-13T01:21:45.349 INFO:teuthology.orchestra.run.trial134.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 93 kB/s | 20 kB 00:00 2026-02-13T01:21:45.534 INFO:teuthology.orchestra.run.trial134.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 544 kB/s | 191 kB 00:00 2026-02-13T01:21:45.763 INFO:teuthology.orchestra.run.trial134.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 2.7 MB/s | 1.6 MB 00:00 2026-02-13T01:21:45.774 INFO:teuthology.orchestra.run.trial134.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 286 kB/s | 122 kB 00:00 2026-02-13T01:21:45.839 INFO:teuthology.orchestra.run.trial134.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 37 MB/s | 2.4 MB 00:00 2026-02-13T01:21:45.868 INFO:teuthology.orchestra.run.trial134.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 66 MB/s | 1.9 MB 00:00 2026-02-13T01:21:45.877 INFO:teuthology.orchestra.run.trial134.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 4.0 MB/s | 37 kB 00:00 2026-02-13T01:21:45.887 INFO:teuthology.orchestra.run.trial134.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 24 MB/s | 248 kB 00:00 2026-02-13T01:21:45.907 INFO:teuthology.orchestra.run.trial134.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 42 MB/s | 866 kB 00:00 2026-02-13T01:21:45.969 INFO:teuthology.orchestra.run.trial134.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 7.2 MB/s | 454 kB 00:00 2026-02-13T01:21:46.014 INFO:teuthology.orchestra.run.trial134.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 33 MB/s | 1.5 MB 00:00 2026-02-13T01:21:46.041 INFO:teuthology.orchestra.run.trial134.stdout:(170/173): openssl-fips-provider-3.5.5-1.el9.x8 29 MB/s | 814 kB 00:00 2026-02-13T01:21:46.105 INFO:teuthology.orchestra.run.trial134.stdout:(171/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 36 MB/s | 2.3 MB 00:00 2026-02-13T01:21:46.214 INFO:teuthology.orchestra.run.trial134.stdout:(172/173): librados2-20.3.0-5241.g8f8d3829.el9. 5.1 MB/s | 3.5 MB 00:00 2026-02-13T01:21:46.227 INFO:teuthology.orchestra.run.trial028.stdout:(162/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 2.2 MB/s | 2.8 MB 00:01 2026-02-13T01:21:46.709 INFO:teuthology.orchestra.run.trial028.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 4.9 MB/s | 2.4 MB 00:00 2026-02-13T01:21:46.807 INFO:teuthology.orchestra.run.trial028.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 19 MB/s | 1.9 MB 00:00 2026-02-13T01:21:46.892 INFO:teuthology.orchestra.run.trial028.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 440 kB/s | 37 kB 00:00 2026-02-13T01:21:46.915 INFO:teuthology.orchestra.run.trial028.stdout:(166/173): librados2-20.3.0-5241.g8f8d3829.el9. 1.7 MB/s | 3.5 MB 00:01 2026-02-13T01:21:46.977 INFO:teuthology.orchestra.run.trial028.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 2.8 MB/s | 248 kB 00:00 2026-02-13T01:21:47.064 INFO:teuthology.orchestra.run.trial028.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 5.1 MB/s | 454 kB 00:00 2026-02-13T01:21:47.075 INFO:teuthology.orchestra.run.trial134.stdout:(173/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 2.1 MB/s | 2.8 MB 00:01 2026-02-13T01:21:47.078 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:21:47.078 INFO:teuthology.orchestra.run.trial134.stdout:Total 9.4 MB/s | 302 MB 00:31 2026-02-13T01:21:47.161 INFO:teuthology.orchestra.run.trial028.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2026-02-13T01:21:47.303 INFO:teuthology.orchestra.run.trial028.stdout:(170/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 2.2 MB/s | 78 MB 00:36 2026-02-13T01:21:47.310 INFO:teuthology.orchestra.run.trial028.stdout:(171/173): openssl-fips-provider-3.5.5-1.el9.x8 5.3 MB/s | 814 kB 00:00 2026-02-13T01:21:47.409 INFO:teuthology.orchestra.run.trial028.stdout:(172/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 22 MB/s | 2.3 MB 00:00 2026-02-13T01:21:47.431 INFO:teuthology.orchestra.run.trial028.stdout:(173/173): iproute-6.17.0-2.el9.x86_64.rpm 1.6 MB/s | 866 kB 00:00 2026-02-13T01:21:47.434 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:21:47.435 INFO:teuthology.orchestra.run.trial028.stdout:Total 6.4 MB/s | 302 MB 00:47 2026-02-13T01:21:47.842 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-13T01:21:47.911 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-13T01:21:47.911 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-13T01:21:48.962 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-13T01:21:49.001 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-13T01:21:49.001 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-13T01:21:49.057 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-13T01:21:49.058 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-13T01:21:50.166 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-13T01:21:50.168 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:21:50.176 INFO:teuthology.orchestra.run.trial134.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:21:50.188 INFO:teuthology.orchestra.run.trial134.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:21:50.193 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:21:50.194 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:21:50.199 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:21:50.240 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:21:50.246 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:21:50.279 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:50.282 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:50.318 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-13T01:21:50.319 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-13T01:21:50.386 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:50.389 INFO:teuthology.orchestra.run.trial134.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:21:50.425 INFO:teuthology.orchestra.run.trial134.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:21:50.447 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:21:50.458 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:21:50.462 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:21:50.467 INFO:teuthology.orchestra.run.trial134.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:21:50.472 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:21:50.475 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:21:50.480 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:21:50.503 INFO:teuthology.orchestra.run.trial134.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:21:50.516 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:21:50.522 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:21:50.525 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:21:50.531 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:21:50.532 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:21:50.534 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:21:50.544 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:21:50.579 INFO:teuthology.orchestra.run.trial134.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:21:50.583 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:21:50.585 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:21:50.586 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:50.610 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:50.616 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:21:50.640 INFO:teuthology.orchestra.run.trial134.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:21:50.645 INFO:teuthology.orchestra.run.trial134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:21:50.648 INFO:teuthology.orchestra.run.trial134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:21:50.650 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:21:50.653 INFO:teuthology.orchestra.run.trial134.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:21:50.681 INFO:teuthology.orchestra.run.trial134.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:21:50.735 INFO:teuthology.orchestra.run.trial134.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:21:50.747 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:21:50.753 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:21:50.760 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:21:50.778 INFO:teuthology.orchestra.run.trial134.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:21:50.784 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:21:50.938 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:21:50.942 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:51.079 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:51.081 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:51.131 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:51.132 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:51.160 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:51.162 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:21:51.170 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:21:51.173 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:21:51.234 INFO:teuthology.orchestra.run.trial134.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:21:51.249 INFO:teuthology.orchestra.run.trial134.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:21:51.256 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:21:51.257 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:51.278 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:51.279 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:51.306 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:51.313 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:21:51.322 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:21:51.334 INFO:teuthology.orchestra.run.trial134.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:21:51.391 INFO:teuthology.orchestra.run.trial134.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:21:51.421 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:21:51.427 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:21:51.431 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:21:51.445 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:21:51.450 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:21:51.455 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:21:51.466 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:21:51.471 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:21:51.480 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:21:51.484 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:21:51.492 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:21:51.533 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:21:51.653 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-13T01:21:51.658 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:21:51.670 INFO:teuthology.orchestra.run.trial028.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:21:51.688 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:21:51.696 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:21:51.700 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:21:51.707 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:21:51.771 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:21:51.776 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:21:51.835 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:51.842 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:51.863 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:21:51.873 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:21:51.877 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:21:51.883 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:21:51.886 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:21:51.892 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:21:51.894 INFO:teuthology.orchestra.run.trial134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:21:51.896 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:21:51.925 INFO:teuthology.orchestra.run.trial134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:21:51.968 INFO:teuthology.orchestra.run.trial134.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:21:51.972 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:21:51.976 INFO:teuthology.orchestra.run.trial134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:21:51.982 INFO:teuthology.orchestra.run.trial134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:21:52.000 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:52.007 INFO:teuthology.orchestra.run.trial028.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:21:52.010 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:21:52.017 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:21:52.020 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:21:52.026 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:21:52.030 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:21:52.037 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:21:52.041 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:21:52.049 INFO:teuthology.orchestra.run.trial028.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:21:52.069 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:21:52.079 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:21:52.083 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:21:52.085 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:21:52.092 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:21:52.101 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:21:52.108 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:21:52.117 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:21:52.126 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:21:52.127 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:21:52.132 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:21:52.137 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:21:52.139 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:21:52.175 INFO:teuthology.orchestra.run.trial028.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:21:52.195 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:21:52.205 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:21:52.211 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:21:52.219 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:21:52.222 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:21:52.225 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:21:52.240 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:21:52.291 INFO:teuthology.orchestra.run.trial028.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:21:52.298 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:21:52.302 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:21:52.303 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:52.345 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:52.357 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:21:52.366 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:21:52.390 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:21:52.394 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:21:52.394 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:21:52.403 INFO:teuthology.orchestra.run.trial028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:21:52.407 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:21:52.412 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:21:52.417 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:21:52.451 INFO:teuthology.orchestra.run.trial134.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:21:52.453 INFO:teuthology.orchestra.run.trial134.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:21:52.458 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:21:52.474 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:21:52.533 INFO:teuthology.orchestra.run.trial028.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:21:52.553 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:21:52.563 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:21:52.576 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:21:52.602 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:21:52.611 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:21:52.774 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:21:52.778 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:52.806 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:21:52.881 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:21:52.936 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:52.939 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:53.002 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:53.005 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:53.046 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:53.050 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:21:53.062 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:21:53.067 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:21:53.157 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:21:53.176 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:21:53.185 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:21:53.187 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:53.222 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:53.224 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:53.264 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:53.274 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:21:53.288 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:21:53.306 INFO:teuthology.orchestra.run.trial028.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:21:53.404 INFO:teuthology.orchestra.run.trial028.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:21:53.455 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:21:53.466 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:21:53.472 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:21:53.494 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:21:53.502 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:21:53.511 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:21:53.528 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:21:53.537 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:21:53.551 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:21:53.559 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:21:53.563 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:21:53.572 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:21:53.577 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:21:53.581 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:21:53.583 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:21:53.589 INFO:teuthology.orchestra.run.trial134.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:21:53.632 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:21:53.877 INFO:teuthology.orchestra.run.trial134.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:21:53.878 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:53.897 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:53.898 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:21:54.096 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:21:54.114 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:21:54.121 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:21:54.131 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:21:54.138 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:21:54.148 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:21:54.152 INFO:teuthology.orchestra.run.trial028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:21:54.155 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:21:54.201 INFO:teuthology.orchestra.run.trial028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:21:54.267 INFO:teuthology.orchestra.run.trial028.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:21:54.275 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:21:54.281 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:21:54.292 INFO:teuthology.orchestra.run.trial028.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:21:54.333 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:21:54.344 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:21:54.350 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:21:54.360 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:21:54.366 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:21:54.377 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:21:54.383 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:21:54.424 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:21:54.441 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:21:54.452 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:21:54.463 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:21:54.514 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:21:54.533 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:21:54.836 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:21:54.875 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:21:54.882 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:21:54.955 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:21:54.958 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:21:54.986 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:21:55.011 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:55.013 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:55.035 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:55.049 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:21:55.065 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:21:55.143 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:21:55.151 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:21:55.175 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:21:55.206 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:21:55.258 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:21:55.264 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:21:55.267 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:21:55.272 INFO:teuthology.orchestra.run.trial134.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:21:55.274 INFO:teuthology.orchestra.run.trial134.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:21:55.275 INFO:teuthology.orchestra.run.trial134.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:55.292 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:55.450 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:21:55.546 INFO:teuthology.orchestra.run.trial134.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:21:55.549 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:55.564 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:21:55.588 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:55.588 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:21:55.588 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:21:55.588 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:21:55.592 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:21:56.524 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:21:56.557 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:21:56.563 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:21:56.567 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:21:56.575 INFO:teuthology.orchestra.run.trial028.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:21:56.879 INFO:teuthology.orchestra.run.trial028.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:21:56.882 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:56.918 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:56.921 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:21:58.137 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:58.144 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:58.181 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:58.202 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:21:58.225 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:21:58.340 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:21:58.358 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:21:58.393 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:21:58.438 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:21:58.511 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:21:58.523 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:21:58.529 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:21:58.537 INFO:teuthology.orchestra.run.trial028.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:21:58.542 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:21:58.544 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:58.581 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:58.869 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:21:58.878 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:58.948 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:58.948 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:21:58.948 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:21:58.949 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:21:58.955 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:00.282 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /sys 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /proc 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /mnt 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /var/tmp 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /home 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /root 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /tmp 2026-02-13T01:22:00.283 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:00.386 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:00.410 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:00.410 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:00.410 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:22:00.410 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:00.410 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:00.410 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:00.627 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:00.648 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:00.648 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:00.648 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:22:00.648 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:00.648 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:00.648 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:00.654 INFO:teuthology.orchestra.run.trial134.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:22:00.656 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:22:00.674 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:00.674 INFO:teuthology.orchestra.run.trial134.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:22:00.674 INFO:teuthology.orchestra.run.trial134.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:22:00.674 INFO:teuthology.orchestra.run.trial134.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:22:00.674 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:00.682 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:00.706 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:00.706 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:22:00.706 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:00.741 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:22:01.370 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:22:02.142 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:22:02.206 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:22:02.208 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:02.222 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:02.222 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:02.222 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:22:02.222 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:02.233 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:02.258 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:02.258 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:02.258 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:22:02.258 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:02.258 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:02.258 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:02.318 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:02.320 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:02.329 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:22:02.353 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:22:02.354 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:03.940 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:03.947 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:04.404 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:04.405 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:04.466 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:04.509 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:22:04.511 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:04.532 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:04.532 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:04.532 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:22:04.532 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:04.532 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:04.532 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:04.543 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:04.553 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /sys 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /proc 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /mnt 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /var/tmp 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /home 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /root 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /tmp 2026-02-13T01:22:04.970 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:05.085 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:05.132 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:22:05.133 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:05.133 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.133 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:22:05.134 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:05.134 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:05.134 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:05.134 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:05.156 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:05.156 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.156 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:22:05.156 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:05.156 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:05.156 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:05.165 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:05.185 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:05.185 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.186 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:22:05.186 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:05.199 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:05.219 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:05.219 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.219 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:22:05.219 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:05.220 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:05.220 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:05.345 INFO:teuthology.orchestra.run.trial134.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:05.365 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:05.365 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.365 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:22:05.365 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:05.365 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:05.365 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:05.368 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:05.415 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:05.415 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.415 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:22:05.415 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:05.416 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:05.416 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:05.427 INFO:teuthology.orchestra.run.trial028.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:22:05.429 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:22:05.467 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:05.467 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:22:05.467 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:22:05.467 INFO:teuthology.orchestra.run.trial028.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:22:05.467 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:05.481 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:05.533 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:05.533 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:22:05.533 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:05.585 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:22:06.244 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:22:07.044 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:22:07.133 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:22:07.138 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:07.170 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:07.170 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:07.170 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:22:07.170 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:07.185 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:07.237 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:07.237 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:07.237 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:22:07.237 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:07.237 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:07.237 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:07.356 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:07.359 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:07.372 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:22:07.405 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:22:07.409 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:08.859 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:22:08.873 INFO:teuthology.orchestra.run.trial134.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:22:08.876 INFO:teuthology.orchestra.run.trial134.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:22:08.954 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:22:08.973 INFO:teuthology.orchestra.run.trial134.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:22:08.978 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:22:08.979 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:22:09.100 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:09.104 INFO:teuthology.orchestra.run.trial134.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:09.122 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:09.127 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:22:09.136 INFO:teuthology.orchestra.run.trial134.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:22:09.180 INFO:teuthology.orchestra.run.trial134.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:09.280 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:09.294 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:09.631 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:22:09.657 INFO:teuthology.orchestra.run.trial134.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:22:09.659 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:22:09.662 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:09.664 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:22:09.673 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:22:09.700 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:22:09.703 INFO:teuthology.orchestra.run.trial134.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:22:09.705 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:09.708 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:22:09.708 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:09.723 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:09.723 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:09.736 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:09.737 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:22:09.739 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:22:09.741 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:22:09.747 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:09.747 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:09.799 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:09.801 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:09.838 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:09.841 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:22:09.844 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:22:09.845 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:09.851 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:22:09.858 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:09.882 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:09.897 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:09.945 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:22:09.948 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:09.995 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:09.996 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:09.996 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:22:09.996 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:09.996 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:09.996 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:10.014 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:10.034 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:10.643 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:22:10.647 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:10.694 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:10.694 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:10.694 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:22:10.694 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:10.694 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:10.694 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:10.707 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:10.752 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:10.753 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:10.753 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:22:10.753 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:10.769 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:10.816 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:10.816 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:10.817 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:22:10.817 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:10.817 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:10.817 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:10.825 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:22:10.826 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:22:10.827 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:22:10.828 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:22:10.829 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:22:10.830 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:22:10.831 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:22:10.832 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:22:10.833 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:22:10.834 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:22:10.835 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:22:10.836 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:22:10.837 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:22:10.838 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:22:10.839 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:22:10.840 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:22:10.890 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:10.890 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout:Upgraded: 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:10.891 INFO:teuthology.orchestra.run.trial134.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.892 INFO:teuthology.orchestra.run.trial134.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.893 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:22:10.894 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.895 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:22:10.896 INFO:teuthology.orchestra.run.trial134.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:22:10.897 INFO:teuthology.orchestra.run.trial134.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:22:10.898 INFO:teuthology.orchestra.run.trial134.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.899 INFO:teuthology.orchestra.run.trial134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:22:10.900 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:10.901 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.902 INFO:teuthology.orchestra.run.trial134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:22:10.903 INFO:teuthology.orchestra.run.trial134.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:22:10.904 INFO:teuthology.orchestra.run.trial134.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:22:10.905 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-13T01:22:10.953 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:10.989 DEBUG:teuthology.parallel:result is None 2026-02-13T01:22:11.002 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:11.002 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:11.002 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:22:11.002 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:11.003 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:11.003 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:14.661 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:22:14.682 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:22:14.687 INFO:teuthology.orchestra.run.trial028.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:22:14.797 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:22:14.829 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:22:14.837 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:22:14.839 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:22:15.045 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:15.055 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:15.093 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:15.099 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:22:15.111 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:22:15.159 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:16.024 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:22:16.071 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:22:16.075 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:22:16.080 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:16.083 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:22:16.098 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:22:16.140 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:22:16.146 INFO:teuthology.orchestra.run.trial028.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:22:16.150 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:16.157 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:22:16.157 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:16.186 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:16.186 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:16.213 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:16.215 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:22:16.218 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:22:16.221 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:22:16.234 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:16.234 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:16.380 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:16.385 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:22:16.391 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:22:16.395 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:16.409 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:22:16.423 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:16.456 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:16.610 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:16.610 INFO:teuthology.orchestra.run.trial028.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-13T01:22:16.611 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:17.642 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:22:17.642 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:22:17.642 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:22:17.643 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:22:17.644 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:22:17.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:22:17.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:22:17.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:22:17.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:22:17.645 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:22:17.655 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:22:17.657 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:22:17.658 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:22:17.659 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:22:17.660 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:22:17.661 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:22:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:22:17.663 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:22:17.664 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:17.747 INFO:teuthology.orchestra.run.trial028.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-13T01:22:17.748 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.749 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.750 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.751 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:17.752 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:22:17.752 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:22:17.752 INFO:teuthology.orchestra.run.trial028.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:22:17.752 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:22:17.752 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:22:17.752 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.753 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:22:17.754 INFO:teuthology.orchestra.run.trial028.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:22:17.755 INFO:teuthology.orchestra.run.trial028.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:22:17.756 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:22:17.757 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:22:17.758 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:22:17.759 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:22:17.760 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:22:17.761 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:22:17.762 INFO:teuthology.orchestra.run.trial028.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:17.763 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-13T01:22:17.996 DEBUG:teuthology.parallel:result is None 2026-02-13T01:22:17.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:18.121 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:22:18.163 INFO:teuthology.orchestra.run.trial028.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:18.163 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:18.163 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:22:18.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:18.282 DEBUG:teuthology.orchestra.run.trial134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:22:18.304 INFO:teuthology.orchestra.run.trial134.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:18.304 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:18.304 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:22:18.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:18.421 DEBUG:teuthology.orchestra.run.trial187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:22:18.443 INFO:teuthology.orchestra.run.trial187.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:18.443 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:18.443 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:22:18.444 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T01:22:18.444 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:18.444 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:22:18.500 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:22:18.500 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:22:18.528 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:22:18.529 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:22:18.557 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T01:22:18.557 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:18.557 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:22:18.610 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:22:18.706 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:22:18.706 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:22:18.732 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:22:18.796 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:22:18.797 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:22:18.823 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:22:18.888 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T01:22:18.888 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:18.889 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:22:18.944 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:22:19.038 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:22:19.038 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:22:19.064 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:22:19.131 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:22:19.131 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:22:19.157 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:22:19.222 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T01:22:19.223 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:19.223 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:22:19.278 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:22:19.373 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:22:19.373 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:22:19.399 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:22:19.464 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:22:19.464 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:22:19.490 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:22:19.554 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T01:22:19.682 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-13T01:22:19.683 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:22:19.686 INFO:tasks.cephadm:Cluster fsid is 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:19.686 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T01:22:19.686 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.28', 'mon.b': '10.20.193.134', 'mon.c': '10.20.193.187'} 2026-02-13T01:22:19.686 INFO:tasks.cephadm:First mon is mon.a on trial028 2026-02-13T01:22:19.686 INFO:tasks.cephadm:First mgr is x 2026-02-13T01:22:19.686 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T01:22:19.686 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname $(hostname -s) 2026-02-13T01:22:19.743 DEBUG:teuthology.orchestra.run.trial134:> sudo hostname $(hostname -s) 2026-02-13T01:22:19.769 DEBUG:teuthology.orchestra.run.trial187:> sudo hostname $(hostname -s) 2026-02-13T01:22:19.795 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T01:22:19.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:19.952 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T01:22:20.101 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:20.103 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T01:22:20.103 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T01:22:20.103 DEBUG:teuthology.orchestra.run.trial028:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:20.429 INFO:teuthology.orchestra.run.trial028.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:22 /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:20.430 DEBUG:teuthology.orchestra.run.trial134:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:20.723 INFO:teuthology.orchestra.run.trial134.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:22 /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:20.724 DEBUG:teuthology.orchestra.run.trial187:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.025 INFO:teuthology.orchestra.run.trial187.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:22 /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.026 DEBUG:teuthology.orchestra.run.trial028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.066 DEBUG:teuthology.orchestra.run.trial134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.085 DEBUG:teuthology.orchestra.run.trial187:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.129 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T01:22:21.130 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:22:21.134 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:22:21.136 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:22:21.297 INFO:teuthology.orchestra.run.trial134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:21.313 INFO:teuthology.orchestra.run.trial187.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:21.490 INFO:teuthology.orchestra.run.trial028.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:36.096 INFO:teuthology.orchestra.run.trial134.stdout:{ 2026-02-13T01:22:36.097 INFO:teuthology.orchestra.run.trial134.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:22:36.097 INFO:teuthology.orchestra.run.trial134.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:22:36.097 INFO:teuthology.orchestra.run.trial134.stdout: "repo_digests": [ 2026-02-13T01:22:36.097 INFO:teuthology.orchestra.run.trial134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:22:36.097 INFO:teuthology.orchestra.run.trial134.stdout: ] 2026-02-13T01:22:36.097 INFO:teuthology.orchestra.run.trial134.stdout:} 2026-02-13T01:22:36.725 INFO:teuthology.orchestra.run.trial187.stdout:{ 2026-02-13T01:22:36.725 INFO:teuthology.orchestra.run.trial187.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:22:36.725 INFO:teuthology.orchestra.run.trial187.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:22:36.725 INFO:teuthology.orchestra.run.trial187.stdout: "repo_digests": [ 2026-02-13T01:22:36.726 INFO:teuthology.orchestra.run.trial187.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:22:36.726 INFO:teuthology.orchestra.run.trial187.stdout: ] 2026-02-13T01:22:36.726 INFO:teuthology.orchestra.run.trial187.stdout:} 2026-02-13T01:22:37.861 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-13T01:22:37.861 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:22:37.861 INFO:teuthology.orchestra.run.trial028.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:22:37.861 INFO:teuthology.orchestra.run.trial028.stdout: "repo_digests": [ 2026-02-13T01:22:37.861 INFO:teuthology.orchestra.run.trial028.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:22:37.861 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-13T01:22:37.862 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-13T01:22:37.885 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /etc/ceph 2026-02-13T01:22:37.948 DEBUG:teuthology.orchestra.run.trial134:> sudo mkdir -p /etc/ceph 2026-02-13T01:22:37.976 DEBUG:teuthology.orchestra.run.trial187:> sudo mkdir -p /etc/ceph 2026-02-13T01:22:38.004 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 777 /etc/ceph 2026-02-13T01:22:38.061 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod 777 /etc/ceph 2026-02-13T01:22:38.087 DEBUG:teuthology.orchestra.run.trial187:> sudo chmod 777 /etc/ceph 2026-02-13T01:22:38.112 INFO:tasks.cephadm:Writing seed config... 2026-02-13T01:22:38.114 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T01:22:38.114 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-13T01:22:38.114 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T01:22:38.115 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T01:22:38.116 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2026-02-13T01:22:38.117 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:38.117 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T01:22:38.155 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 70ced355-087a-11f1-9708-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 2026-02-13T01:22:38.155 DEBUG:teuthology.orchestra.run.trial028:mon.a> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a.service 2026-02-13T01:22:38.199 DEBUG:teuthology.orchestra.run.trial028:mgr.x> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x.service 2026-02-13T01:22:38.245 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T01:22:38.245 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.28 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:38.436 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:22:38.437 INFO:teuthology.orchestra.run.trial028.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.28', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T01:22:38.437 INFO:teuthology.orchestra.run.trial028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T01:22:38.437 INFO:teuthology.orchestra.run.trial028.stdout:Verifying podman|docker is present... 2026-02-13T01:22:38.470 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-13T01:22:38.470 INFO:teuthology.orchestra.run.trial028.stdout:Verifying lvm2 is present... 2026-02-13T01:22:38.471 INFO:teuthology.orchestra.run.trial028.stdout:Verifying time synchronization is in place... 2026-02-13T01:22:38.480 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T01:22:38.480 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T01:22:38.490 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T01:22:38.490 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-13T01:22:38.502 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-13T01:22:38.512 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-13T01:22:38.512 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-13T01:22:38.512 INFO:teuthology.orchestra.run.trial028.stdout:Repeating the final host check... 2026-02-13T01:22:38.544 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-13T01:22:38.545 INFO:teuthology.orchestra.run.trial028.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T01:22:38.545 INFO:teuthology.orchestra.run.trial028.stdout:systemctl is present 2026-02-13T01:22:38.545 INFO:teuthology.orchestra.run.trial028.stdout:lvcreate is present 2026-02-13T01:22:38.555 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T01:22:38.555 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T01:22:38.565 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T01:22:38.566 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-13T01:22:38.578 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-13T01:22:38.588 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-13T01:22:38.588 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-13T01:22:38.588 INFO:teuthology.orchestra.run.trial028.stdout:Host looks OK 2026-02-13T01:22:38.589 INFO:teuthology.orchestra.run.trial028.stdout:Cluster fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:38.589 INFO:teuthology.orchestra.run.trial028.stdout:Acquiring lock 140006123625920 on /run/cephadm/70ced355-087a-11f1-9708-d404e6e7d460.lock 2026-02-13T01:22:38.589 INFO:teuthology.orchestra.run.trial028.stdout:Lock 140006123625920 acquired on /run/cephadm/70ced355-087a-11f1-9708-d404e6e7d460.lock 2026-02-13T01:22:38.589 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 3300 ... 2026-02-13T01:22:38.589 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 6789 ... 2026-02-13T01:22:38.590 INFO:teuthology.orchestra.run.trial028.stdout:Base mon IP(s) is [10.20.193.28:3300, 10.20.193.28:6789], mon addrv is [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-13T01:22:38.595 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-13T01:22:38.595 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-13T01:22:38.601 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T01:22:38.601 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-13T01:22:38.606 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T01:22:38.606 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T01:22:38.607 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:22:38.607 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-13T01:22:38.607 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-13T01:22:38.607 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:22:38.608 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-13T01:22:38.608 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-13T01:22:38.608 INFO:teuthology.orchestra.run.trial028.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T01:22:38.608 INFO:teuthology.orchestra.run.trial028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T01:22:38.608 INFO:teuthology.orchestra.run.trial028.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:38.846 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T01:22:38.846 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:38.847 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T01:22:38.847 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T01:22:38.847 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T01:22:38.847 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T01:22:38.847 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T01:22:39.092 INFO:teuthology.orchestra.run.trial028.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T01:22:39.092 INFO:teuthology.orchestra.run.trial028.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T01:22:39.092 INFO:teuthology.orchestra.run.trial028.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T01:22:39.301 INFO:teuthology.orchestra.run.trial028.stdout:stat: stdout 167 167 2026-02-13T01:22:39.301 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial keys... 2026-02-13T01:22:39.514 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDffI5pKNPqGhAAewLqa4Y4eLV/fj7ST1WBcg== 2026-02-13T01:22:39.736 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDffI5pEO8TJhAAMgC3p84sY8lDyMbJsv3pIQ== 2026-02-13T01:22:39.967 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDffI5p7lLpMxAAGjAoyeBcBwc+A66jPT7c9g== 2026-02-13T01:22:39.968 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial monmap... 2026-02-13T01:22:40.184 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T01:22:40.184 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool for a [v2:10.20.193.28:3300,v1:10.20.193.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:setting min_mon_release = tentacle 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: set fsid to 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:40.185 INFO:teuthology.orchestra.run.trial028.stdout:Creating mon... 2026-02-13T01:22:40.453 INFO:teuthology.orchestra.run.trial028.stdout:create mon.a on 2026-02-13T01:22:40.704 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T01:22:40.882 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T01:22:41.070 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-70ced355-087a-11f1-9708-d404e6e7d460.target → /etc/systemd/system/ceph-70ced355-087a-11f1-9708-d404e6e7d460.target. 2026-02-13T01:22:41.071 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-70ced355-087a-11f1-9708-d404e6e7d460.target → /etc/systemd/system/ceph-70ced355-087a-11f1-9708-d404e6e7d460.target. 2026-02-13T01:22:41.283 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a 2026-02-13T01:22:41.283 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a.service: Unit ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a.service not loaded. 2026-02-13T01:22:41.509 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-70ced355-087a-11f1-9708-d404e6e7d460.target.wants/ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-70ced355-087a-11f1-9708-d404e6e7d460@.service. 2026-02-13T01:22:41.784 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:22:41.784 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-13T01:22:41.795 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:22:41.795 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-13T01:22:41.796 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-13T01:22:41.796 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T01:22:41.796 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon to start... 2026-02-13T01:22:41.796 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon... 2026-02-13T01:22:41.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:41 trial028 ceph-mon[22638]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout id: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout services: 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.223239s) [leader: a] 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T01:22:42.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout data: 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:mon is available 2026-02-13T01:22:42.107 INFO:teuthology.orchestra.run.trial028.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T01:22:42.399 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.399 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T01:22:42.399 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:42.399 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T01:22:42.399 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-13T01:22:42.399 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T01:22:42.401 INFO:teuthology.orchestra.run.trial028.stdout:Generating new minimal ceph.conf... 2026-02-13T01:22:42.883 INFO:teuthology.orchestra.run.trial028.stdout:Restarting the monitor... 2026-02-13T01:22:42.884 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:22:42.884 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: monmap epoch 1 2026-02-13T01:22:42.884 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:42.884 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: last_changed 2026-02-13T01:22:40.089699+0000 2026-02-13T01:22:42.884 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:22:42.884 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: min_mon_release 20 (tentacle) 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: election_strategy: 1 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: fsmap 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: mgrmap e1: no daemons active 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: from='client.? 10.20.193.28:0/3615953094' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: from='client.? 10.20.193.28:0/2929739083' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: from='client.? 10.20.193.28:0/2929739083' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-13T01:22:42.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 ceph-mon[22638]: from='client.? 10.20.193.28:0/1485893476' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:43.193 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:42 trial028 systemd[1]: Stopping Ceph mon.a for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:22:43.193 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a[22634]: 2026-02-13T01:22:43.031+0000 7fb06a5dc6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:22:43.194 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a[22634]: 2026-02-13T01:22:43.031+0000 7fb06a5dc6c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T01:22:43.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 podman[22875]: 2026-02-13 01:22:43.194172199 +0000 UTC m=+0.188699076 container died 629ba2179de952bbf8c70e0f10de67002dd2eb86e8d44ec76027bced63a54c38 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T01:22:43.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 podman[22875]: 2026-02-13 01:22:43.375728366 +0000 UTC m=+0.370255243 container remove 629ba2179de952bbf8c70e0f10de67002dd2eb86e8d44ec76027bced63a54c38 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, version=10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.version=10) 2026-02-13T01:22:43.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 bash[22875]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a 2026-02-13T01:22:43.745 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 systemd[1]: ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T01:22:43.746 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 systemd[1]: Stopped Ceph mon.a for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:22:43.746 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 systemd[1]: Starting Ceph mon.a for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:22:43.800 INFO:teuthology.orchestra.run.trial028.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 podman[22965]: 2026-02-13 01:22:43.746331927 +0000 UTC m=+0.113419711 container create 13c52e80a4dcc06e96f8b1f53307b4b2eb62dd3f1c1782cbab57a6c22baa5ceb (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, version=10, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10) 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 podman[22965]: 2026-02-13 01:22:43.652036961 +0000 UTC m=+0.019124685 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 podman[22965]: 2026-02-13 01:22:43.788153846 +0000 UTC m=+0.155241570 container init 13c52e80a4dcc06e96f8b1f53307b4b2eb62dd3f1c1782cbab57a6c22baa5ceb (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, name=rockylinux, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 podman[22965]: 2026-02-13 01:22:43.793256805 +0000 UTC m=+0.160344509 container start 13c52e80a4dcc06e96f8b1f53307b4b2eb62dd3f1c1782cbab57a6c22baa5ceb (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, name=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image) 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 bash[22965]: 13c52e80a4dcc06e96f8b1f53307b4b2eb62dd3f1c1782cbab57a6c22baa5ceb 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 systemd[1]: Started Ceph mon.a for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:22:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: pidfile_write: ignore empty --pid-file 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: load: jerasure load: lrc 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: RocksDB version: 7.9.2 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Git sha 0 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: DB SUMMARY 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: DB Session ID: KICHSWVI07TSX5N9AF4S 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: CURRENT file: CURRENT 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T01:22:44.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95703 ; 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.error_if_exists: 0 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.create_if_missing: 0 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.paranoid_checks: 1 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.env: 0x5601e039f2c0 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.info_log: 0x5601f8eacee0 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.statistics: (nil) 2026-02-13T01:22:44.039 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.use_fsync: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_log_file_size: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.allow_fallocate: 1 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.use_direct_reads: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.db_log_dir: 2026-02-13T01:22:44.040 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.wal_dir: 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.write_buffer_manager: 0x5601f8ea3b80 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T01:22:44.041 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.unordered_write: 0 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.row_cache: None 2026-02-13T01:22:44.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.wal_filter: None 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.two_write_queues: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.wal_compression: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.atomic_flush: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.log_readahead_size: 0 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T01:22:44.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_background_jobs: 2 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_background_compactions: -1 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_subcompactions: 1 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T01:22:44.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_open_files: -1 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_background_flushes: -1 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Compression algorithms supported: 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kZSTD supported: 0 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kXpressCompression supported: 0 2026-02-13T01:22:44.045 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kBZip2Compression supported: 0 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kLZ4Compression supported: 1 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kZlibCompression supported: 1 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: kSnappyCompression supported: 1 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.merge_operator: 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_filter: None 2026-02-13T01:22:44.046 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5601f902c3e0) 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks: 1 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_top_level_index_and_filter: 1 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: index_type: 0 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_index_type: 0 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: index_shortening: 1 2026-02-13T01:22:44.047 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: checksum: 4 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: no_block_cache: 0 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache: 0x5601f8ea5690 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_name: BinnedLRUCache 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_options: 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: capacity : 536870912 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: num_shard_bits : 4 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: strict_capacity_limit : 0 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: high_pri_pool_ratio: 0.000 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_compressed: (nil) 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: persistent_cache: (nil) 2026-02-13T01:22:44.048 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size: 4096 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size_deviation: 10 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: block_restart_interval: 16 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: index_block_restart_interval: 1 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: metadata_block_size: 4096 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: partition_filters: 0 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: use_delta_encoding: 1 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: filter_policy: bloomfilter 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: whole_key_filtering: 1 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: verify_compression: 0 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: read_amp_bytes_per_bit: 0 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: format_version: 5 2026-02-13T01:22:44.049 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_index_compression: 1 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout: block_align: 0 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout: max_auto_readahead_size: 262144 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout: prepopulate_block_cache: 0 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout: initial_auto_readahead_size: 8192 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression: NoCompression 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.num_levels: 7 2026-02-13T01:22:44.050 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T01:22:44.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T01:22:44.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T01:22:44.053 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T01:22:44.054 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.inplace_update_support: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.bloom_locality: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.max_successive_merges: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T01:22:44.055 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.ttl: 2592000 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.enable_blob_files: false 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.min_blob_size: 0 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T01:22:44.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fc575903-ff95-46bb-8d7c-400f8ef8fc82 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945763822753, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945763823851, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92105, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 276, "table_properties": {"data_size": 90153, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11838, "raw_average_key_size": 48, "raw_value_size": 83475, "raw_average_value_size": 343, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770945763, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fc575903-ff95-46bb-8d7c-400f8ef8fc82", "db_session_id": "KICHSWVI07TSX5N9AF4S", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945763824021, "job": 1, "event": "recovery_finished"} 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5601f8ec8e00 2026-02-13T01:22:44.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: DB pointer 0x5601f9cd2000 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: ** DB Stats ** 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-13T01:22:44.058 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: L0 2/0 91.81 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: Sum 2/0 91.81 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 121.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:44.059 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative compaction: 0.00 GB write, 19.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval compaction: 0.00 GB write, 19.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T01:22:44.060 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache BinnedLRUCache@0x5601f8ea5690#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: starting mon.a rank 0 at public addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] at bind addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???) e1 preinit fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).mds e1 new map 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).mds e1 print_map 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout: e1 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout: btime 2026-02-13T01:22:41:806273+0000 2026-02-13T01:22:44.061 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T01:22:44.062 INFO:journalctl@ceph.mon.a.trial028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T01:22:44.062 INFO:journalctl@ceph.mon.a.trial028.stdout: legacy client fscid: -1 2026-02-13T01:22:44.062 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-13T01:22:44.062 INFO:journalctl@ceph.mon.a.trial028.stdout: No filesystems configured 2026-02-13T01:22:44.062 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T01:22:44.062 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).mgr e0 loading version 1 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).mgr e1 active server: (0) 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a@-1(???).mgr e1 mkfs or daemon transitioned to available, loading commands 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: monmap epoch 1 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: last_changed 2026-02-13T01:22:40.089699+0000 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:22:44.063 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: min_mon_release 20 (tentacle) 2026-02-13T01:22:44.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: election_strategy: 1 2026-02-13T01:22:44.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:22:44.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: fsmap 2026-02-13T01:22:44.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:22:44.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:43 trial028 ceph-mon[22984]: mgrmap e1: no daemons active 2026-02-13T01:22:44.097 INFO:teuthology.orchestra.run.trial028.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T01:22:44.098 INFO:teuthology.orchestra.run.trial028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:44.098 INFO:teuthology.orchestra.run.trial028.stdout:Creating mgr... 2026-02-13T01:22:44.098 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T01:22:44.099 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T01:22:44.317 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x 2026-02-13T01:22:44.317 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x.service: Unit ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T01:22:44.507 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-70ced355-087a-11f1-9708-d404e6e7d460.target.wants/ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-70ced355-087a-11f1-9708-d404e6e7d460@.service. 2026-02-13T01:22:44.696 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 systemd[1]: Starting Ceph mgr.x for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:22:44.766 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:22:44.766 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-13T01:22:44.777 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:22:44.777 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-13T01:22:44.777 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-13T01:22:44.777 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T01:22:44.791 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:22:44.791 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-13T01:22:44.802 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:22:44.802 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-13T01:22:44.802 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-13T01:22:44.802 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T01:22:44.802 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr to start... 2026-02-13T01:22:44.803 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr... 2026-02-13T01:22:45.023 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 podman[23192]: 2026-02-13 01:22:44.702354223 +0000 UTC m=+0.027187565 container create 7e1c873178a04b19621e5b54d0e9df884906ffd60b584d5129abd4517f556604 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, version=10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:22:45.023 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 podman[23192]: 2026-02-13 01:22:44.738476851 +0000 UTC m=+0.063310183 container init 7e1c873178a04b19621e5b54d0e9df884906ffd60b584d5129abd4517f556604 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, ceph=True, summary=Rocky Linux Base image, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:22:45.023 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 podman[23192]: 2026-02-13 01:22:44.743365853 +0000 UTC m=+0.068199195 container start 7e1c873178a04b19621e5b54d0e9df884906ffd60b584d5129abd4517f556604 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True) 2026-02-13T01:22:45.023 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 bash[23192]: 7e1c873178a04b19621e5b54d0e9df884906ffd60b584d5129abd4517f556604 2026-02-13T01:22:45.024 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 podman[23192]: 2026-02-13 01:22:44.692304945 +0000 UTC m=+0.017138297 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:22:45.024 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 systemd[1]: Started Ceph mgr.x for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:22:45.024 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:44.787+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:22:45.024 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:44 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:44.845+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:22:45.148 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:45.148 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:45.148 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "70ced355-087a-11f1-9708-d404e6e7d460", 2026-02-13T01:22:45.148 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T01:22:45.148 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T01:22:45.148 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T01:22:45.149 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.150 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T01:22:41:806273+0000", 2026-02-13T01:22:45.151 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.152 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T01:22:41.806702+0000", 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:45.153 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (1/15)... 2026-02-13T01:22:45.278 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:45 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2938684627' entity='client.admin' 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.196+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.207+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.214+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.220+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.226+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.239+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.265+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:22:45.279 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.269+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:22:45.280 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.271+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:22:45.280 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.278+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.332+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.335+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.339+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.342+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.343+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.346+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:22:45.641 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.347+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:22:45.642 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.350+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:22:45.642 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.353+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:22:45.642 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.640+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:22:45.642 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.640+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.643+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.646+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.648+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.648+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.648+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.853+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:22:45.891 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.885+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:22:45.892 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.890+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:22:45.892 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.891+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:22:46.196 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:45.891+0000 7ffa7b2d8fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:22:46.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1717572172' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: Activating manager daemon x 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: mgrmap e2: x(active, starting, since 0.00324593s) 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: Manager daemon x is now available 2026-02-13T01:22:46.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:22:46.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' 2026-02-13T01:22:46.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:22:46.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' 2026-02-13T01:22:46.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:46 trial028 ceph-mon[22984]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' 2026-02-13T01:22:47.550 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:47.550 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "70ced355-087a-11f1-9708-d404e6e7d460", 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T01:22:47.551 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T01:22:47.552 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T01:22:47.553 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T01:22:41:806273+0000", 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T01:22:47.554 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T01:22:41.806702+0000", 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:47.555 INFO:teuthology.orchestra.run.trial028.stdout:mgr is available 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T01:22:47.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T01:22:47.922 INFO:teuthology.orchestra.run.trial028.stdout:Enabling cephadm module... 2026-02-13T01:22:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:47 trial028 ceph-mon[22984]: mgrmap e3: x(active, since 1.00726s) 2026-02-13T01:22:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:47 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/289097843' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:22:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:47 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3338060445' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:22:49.156 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:48 trial028 ceph-mon[22984]: mgrmap e4: x(active, since 2s) 2026-02-13T01:22:49.156 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:48 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/562587186' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T01:22:49.156 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: ignoring --setuser ceph since I am not root 2026-02-13T01:22:49.156 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: ignoring --setgroup ceph since I am not root 2026-02-13T01:22:49.156 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:48.978+0000 7f0cc840ffc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:22:49.156 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.033+0000 7f0cc840ffc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:22:49.408 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.361+0000 7f0cc840ffc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:22:49.408 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.371+0000 7f0cc840ffc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:22:49.408 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.378+0000 7f0cc840ffc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:22:49.408 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.385+0000 7f0cc840ffc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:22:49.408 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.391+0000 7f0cc840ffc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:22:49.409 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.404+0000 7f0cc840ffc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:22:49.428 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-13T01:22:49.429 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 5... 2026-02-13T01:22:49.696 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.430+0000 7f0cc840ffc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:22:49.696 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.433+0000 7f0cc840ffc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:22:49.696 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.435+0000 7f0cc840ffc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:22:49.696 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.443+0000 7f0cc840ffc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:22:49.696 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.500+0000 7f0cc840ffc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.502+0000 7f0cc840ffc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.506+0000 7f0cc840ffc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.508+0000 7f0cc840ffc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.509+0000 7f0cc840ffc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.513+0000 7f0cc840ffc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.514+0000 7f0cc840ffc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.517+0000 7f0cc840ffc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:22:49.697 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.519+0000 7f0cc840ffc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:22:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/562587186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T01:22:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:49 trial028 ceph-mon[22984]: mgrmap e5: x(active, since 3s) 2026-02-13T01:22:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3213581487' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T01:22:50.196 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.769+0000 7f0cc840ffc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.769+0000 7f0cc840ffc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.771+0000 7f0cc840ffc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.774+0000 7f0cc840ffc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.776+0000 7f0cc840ffc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.776+0000 7f0cc840ffc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.776+0000 7f0cc840ffc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:49.970+0000 7f0cc840ffc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:50.002+0000 7f0cc840ffc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:50.006+0000 7f0cc840ffc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:50.007+0000 7f0cc840ffc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:22:50.197 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:22:50.008+0000 7f0cc840ffc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:22:51.098 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:51.098 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T01:22:51.098 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T01:22:51.098 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:51.098 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 5 is available 2026-02-13T01:22:51.098 INFO:teuthology.orchestra.run.trial028.stdout:Verifying orchestrator module is enabled... 2026-02-13T01:22:51.162 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: Active manager daemon x restarted 2026-02-13T01:22:51.162 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: Activating manager daemon x 2026-02-13T01:22:51.162 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T01:22:51.162 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: mgrmap e6: x(active, starting, since 0.00291651s) 2026-02-13T01:22:51.162 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:51.162 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: Manager daemon x is now available 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:51.163 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:51.164 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.164 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:51.164 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:22:51.164 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:22:52.100 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T01:22:52.101 INFO:teuthology.orchestra.run.trial028.stdout:Setting orchestrator backend to cephadm... 2026-02-13T01:22:52.416 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: Optimize plan auto_2026-02-13_01:22:50, mode upmap, max misplaced 0.050000 2026-02-13T01:22:52.416 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: No pools available 2026-02-13T01:22:52.416 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: Found migration_current of "None". Setting to last migration. 2026-02-13T01:22:52.416 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: mgrmap e7: x(active, since 1.00491s) 2026-02-13T01:22:52.416 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T01:22:52.416 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T01:22:52.417 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:52.417 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3013751841' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T01:22:52.855 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T01:22:52.855 INFO:teuthology.orchestra.run.trial028.stdout:Generating ssh key... 2026-02-13T01:22:53.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:53 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3013751841' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T01:22:53.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:53 trial028 ceph-mon[22984]: mgrmap e8: x(active, since 2s) 2026-02-13T01:22:53.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:53 trial028 ceph-mon[22984]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:53.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:53 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:53.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:53 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:53.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:53 trial028 ceph-mon[22984]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:53.446 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: Generating public/private ed25519 key pair. 2026-02-13T01:22:53.446 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: Your identification has been saved in /tmp/tmpqxi5x62n/key 2026-02-13T01:22:53.446 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: Your public key has been saved in /tmp/tmpqxi5x62n/key.pub 2026-02-13T01:22:53.446 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: The key fingerprint is: 2026-02-13T01:22:53.446 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: SHA256:e+nsm/J1FwHVTawSq+1ka4jMMEaamDQ5pqdWB6JZn1o ceph-70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: The key's randomart image is: 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: +--[ED25519 256]--+ 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: | ..++| 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: | . . +| 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: | . o o | 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: | .B. . o . .| 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: |.*.*.= S o . . | 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: |+ +.E.+ ...+ .| 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: | o.o.. =..o=... .| 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: |... =+.o+. . | 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: |. +Bo | 2026-02-13T01:22:53.447 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:22:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: +----[SHA256]-----+ 2026-02-13T01:22:53.609 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:53.609 INFO:teuthology.orchestra.run.trial028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:22:53.610 INFO:teuthology.orchestra.run.trial028.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T01:22:53.610 INFO:teuthology.orchestra.run.trial028.stdout:Adding host trial028... 2026-02-13T01:22:54.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:54 trial028 ceph-mon[22984]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:54.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:54.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:54.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:54 trial028 ceph-mon[22984]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:54.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:54 trial028 ceph-mon[22984]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:56.274 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Added host 'trial028' with addr '10.20.193.28' 2026-02-13T01:22:56.274 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mon service... 2026-02-13T01:22:56.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T01:22:56.668 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mgr service... 2026-02-13T01:22:57.051 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T01:22:57.181 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:57.181 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:57.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:57.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:57.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:57.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:57.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:57.484 INFO:teuthology.orchestra.run.trial028.stdout:Saving cluster configuration to /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/config directory 2026-02-13T01:22:57.930 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T01:22:57.930 INFO:teuthology.orchestra.run.trial028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T01:22:57.930 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.930 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: ceph telemetry on 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout:For more information see: 2026-02-13T01:22:57.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.932 INFO:teuthology.orchestra.run.trial028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T01:22:57.932 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:22:57.932 INFO:teuthology.orchestra.run.trial028.stdout:Bootstrap complete. 2026-02-13T01:22:57.945 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout static 2026-02-13T01:22:57.955 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T01:22:57.956 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-13T01:22:57.956 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T01:22:58.202 INFO:tasks.cephadm:Fetching config... 2026-02-13T01:22:58.202 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:58.202 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T01:22:58.240 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T01:22:58.240 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:58.240 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T01:22:58.318 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T01:22:58.318 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:58.319 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T01:22:58.366 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:58 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1378722612' entity='client.admin' 2026-02-13T01:22:58.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:58.413 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T01:22:58.414 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:22:58.414 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T01:22:58.494 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T01:22:58.494 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:22:58.610 INFO:teuthology.orchestra.run.trial028.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:58.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:58 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/399316835' entity='client.admin' 2026-02-13T01:22:58.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:22:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:22:58.632 DEBUG:teuthology.orchestra.run.trial134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:22:58.667 INFO:teuthology.orchestra.run.trial134.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:58.678 DEBUG:teuthology.orchestra.run.trial187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:22:58.713 INFO:teuthology.orchestra.run.trial187.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP+2fqR/gjW0vPrJOgcmbXiEkDsmuzOELwDmB0RHjhy6 ceph-70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:22:58.724 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T01:22:58.911 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:22:59.329 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T01:22:59.329 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T01:22:59.517 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:22:59.941 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial134 2026-02-13T01:22:59.941 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:22:59.941 DEBUG:teuthology.orchestra.run.trial134:> dd of=/etc/ceph/ceph.conf 2026-02-13T01:22:59.958 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:22:59.958 DEBUG:teuthology.orchestra.run.trial134:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:00.016 INFO:tasks.cephadm:Adding host trial134 to orchestrator... 2026-02-13T01:23:00.016 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch host add trial134 2026-02-13T01:23:00.200 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:00.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:00 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/715309530' entity='client.admin' 2026-02-13T01:23:00.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:00.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:00 trial028 ceph-mon[22984]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:00.383 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:01.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial134", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:01.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:01.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:01.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:01.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:01.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:01.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:02.292 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial134' with addr '10.20.193.134' 2026-02-13T01:23:02.400 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T01:23:02.585 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:02.891 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:23:02.891 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.134", "hostname": "trial134", "labels": [], "status": ""}] 2026-02-13T01:23:02.998 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial187 2026-02-13T01:23:02.999 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:23:02.999 DEBUG:teuthology.orchestra.run.trial187:> dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:03.018 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:23:03.018 DEBUG:teuthology.orchestra.run.trial187:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:03.077 INFO:tasks.cephadm:Adding host trial187 to orchestrator... 2026-02-13T01:23:03.077 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch host add trial187 2026-02-13T01:23:03.263 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:03.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:03.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:03.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:03.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:03.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:03.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:23:03.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:03 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:04.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:04.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:04 trial028 ceph-mon[22984]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial187", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:04.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:05.405 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial187' with addr '10.20.193.187' 2026-02-13T01:23:05.514 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T01:23:05.697 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:06.016 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:23:06.016 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.134", "hostname": "trial134", "labels": [], "status": ""}, {"addr": "10.20.193.187", "hostname": "trial187", "labels": [], "status": ""}] 2026-02-13T01:23:06.124 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T01:23:06.124 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T01:23:06.310 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:06.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial134", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:06.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:07.480 INFO:teuthology.orchestra.run.trial028.stderr:adjusted tunables profile to default 2026-02-13T01:23:07.588 INFO:tasks.cephadm:Adding mon.a on trial028 2026-02-13T01:23:07.588 INFO:tasks.cephadm:Adding mon.b on trial134 2026-02-13T01:23:07.588 INFO:tasks.cephadm:Adding mon.c on trial187 2026-02-13T01:23:07.589 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch apply mon '3;trial028:10.20.193.28=a;trial134:10.20.193.134=b;trial187:10.20.193.187=c' 2026-02-13T01:23:07.708 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:07.708 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:07.940 INFO:teuthology.orchestra.run.trial187.stdout:Scheduled mon update... 2026-02-13T01:23:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:07 trial028 ceph-mon[22984]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:23:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:07 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1316706601' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T01:23:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:07.982 DEBUG:teuthology.orchestra.run.trial134:mon.b> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.b.service 2026-02-13T01:23:07.985 DEBUG:teuthology.orchestra.run.trial187:mon.c> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.c.service 2026-02-13T01:23:07.988 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:23:07.988 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:23:08.225 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:08.225 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:08.477 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:23:08.477 INFO:teuthology.orchestra.run.trial187.stdout:{"epoch":1,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","modified":"2026-02-13T01:22:40.089699Z","created":"2026-02-13T01:22:40.089699Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:22:40:089721+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T01:23:08.478 INFO:teuthology.orchestra.run.trial187.stderr:dumped monmap epoch 1 2026-02-13T01:23:08.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1316706601' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T01:23:08.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial134:10.20.193.134=b;trial187:10.20.193.187=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial187", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:08 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/3005175807' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:09.519 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:23:09.520 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:23:09.749 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:23:09.786 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 podman[27393]: 2026-02-13 01:23:09.789296892 +0000 UTC m=+0.047666651 container start 0fc64123cc1c0688ec6c57fa0ee1d24f56106650261fcca9ced8409ba66d9bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-c, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:23:09.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:09.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:09.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:09.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:09.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 bash[27393]: 0fc64123cc1c0688ec6c57fa0ee1d24f56106650261fcca9ced8409ba66d9bf3 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 podman[27393]: 2026-02-13 01:23:09.751177448 +0000 UTC m=+0.009547227 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 systemd[1]: Started Ceph mon.c for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: pidfile_write: ignore empty --pid-file 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: load: jerasure load: lrc 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: RocksDB version: 7.9.2 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Git sha 0 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: DB SUMMARY 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: DB Session ID: ZC5QYPQEASO64ENKQZK8 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: CURRENT file: CURRENT 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 519 ; 2026-02-13T01:23:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.error_if_exists: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.create_if_missing: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.paranoid_checks: 1 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.env: 0x56317b9902c0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.info_log: 0x56317cf22d60 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.statistics: (nil) 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.use_fsync: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_log_file_size: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.allow_fallocate: 1 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.use_direct_reads: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T01:23:10.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.db_log_dir: 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.wal_dir: 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.write_buffer_manager: 0x56317cf19b80 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.unordered_write: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.row_cache: None 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.wal_filter: None 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.two_write_queues: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.wal_compression: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.atomic_flush: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.log_readahead_size: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_background_jobs: 2 2026-02-13T01:23:10.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_background_compactions: -1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_subcompactions: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_open_files: -1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_background_flushes: -1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Compression algorithms supported: 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kZSTD supported: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kXpressCompression supported: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kBZip2Compression supported: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kLZ4Compression supported: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kZlibCompression supported: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: kSnappyCompression supported: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.merge_operator: 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_filter: None 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56317d0a2360) 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: cache_index_and_filter_blocks: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: pin_top_level_index_and_filter: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: index_type: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: data_block_index_type: 0 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: index_shortening: 1 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T01:23:10.146 INFO:journalctl@ceph.mon.c.trial187.stdout: checksum: 4 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: no_block_cache: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_cache: 0x56317cf1b690 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_cache_name: BinnedLRUCache 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_cache_options: 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: capacity : 536870912 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: num_shard_bits : 4 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: strict_capacity_limit : 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: high_pri_pool_ratio: 0.000 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_cache_compressed: (nil) 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: persistent_cache: (nil) 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_size: 4096 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_size_deviation: 10 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_restart_interval: 16 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: index_block_restart_interval: 1 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: metadata_block_size: 4096 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: partition_filters: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: use_delta_encoding: 1 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: filter_policy: bloomfilter 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: whole_key_filtering: 1 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: verify_compression: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: read_amp_bytes_per_bit: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: format_version: 5 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: enable_index_compression: 1 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: block_align: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: max_auto_readahead_size: 262144 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: prepopulate_block_cache: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: initial_auto_readahead_size: 8192 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression: NoCompression 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.num_levels: 7 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:23:10.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.inplace_update_support: 0 2026-02-13T01:23:10.148 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.bloom_locality: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.max_successive_merges: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.ttl: 2592000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.enable_blob_files: false 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.min_blob_size: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 29c07cd3-7a84-4e8b-a72d-28ea612e0509 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945789804404, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945789804808, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1655, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 531, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 409, "raw_average_value_size": 81, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770945789, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "29c07cd3-7a84-4e8b-a72d-28ea612e0509", "db_session_id": "ZC5QYPQEASO64ENKQZK8", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945789804855, "job": 1, "event": "recovery_finished"} 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56317cf3ee00 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: DB pointer 0x56317dd44000 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: ** DB Stats ** 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:23:10.149 INFO:journalctl@ceph.mon.c.trial187.stdout: 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: ** Compaction Stats [default] ** 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: L0 1/0 1.62 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Sum 1/0 1.62 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: ** Compaction Stats [default] ** 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Cumulative compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Interval compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Block cache BinnedLRUCache@0x56317cf1b690#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.3e-05 secs_since: 0 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c does not exist in monmap, will attempt to join an existing cluster 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: using public_addr v2:10.20.193.187:0/0 -> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: starting mon.c rank -1 at public addrs [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] at bind addrs [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(???) e0 preinit fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).mds e1 new map 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).mds e1 print_map 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: e1 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: btime 2026-02-13T01:22:41:806273+0000 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: legacy client fscid: -1 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout: No filesystems configured 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-13T01:23:10.150 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mkfs 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: monmap epoch 1 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: last_changed 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: min_mon_release 20 (tentacle) 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: election_strategy: 1 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: fsmap 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e1: no daemons active 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3615953094' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2929739083' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2929739083' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1485893476' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: monmap epoch 1 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: last_changed 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: min_mon_release 20 (tentacle) 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: election_strategy: 1 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: fsmap 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e1: no daemons active 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2938684627' entity='client.admin' 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1717572172' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Activating manager daemon x 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e2: x(active, starting, since 0.00324593s) 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Manager daemon x is now available 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:23:10.151 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14100 10.20.193.28:0/3692009454' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e3: x(active, since 1.00726s) 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/289097843' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3338060445' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e4: x(active, since 2s) 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/562587186' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/562587186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e5: x(active, since 3s) 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3213581487' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Active manager daemon x restarted 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Activating manager daemon x 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e6: x(active, starting, since 0.00291651s) 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Manager daemon x is now available 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.152 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Optimize plan auto_2026-02-13_01:22:50, mode upmap, max misplaced 0.050000 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: No pools available 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: Found migration_current of "None". Setting to last migration. 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e7: x(active, since 1.00491s) 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3013751841' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3013751841' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mgrmap e8: x(active, since 2s) 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1378722612' entity='client.admin' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/399316835' entity='client.admin' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/715309530' entity='client.admin' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial134", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.153 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial187", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial134", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1316706601' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1316706601' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial134:10.20.193.134=b;trial187:10.20.193.187=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial187", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/3005175807' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:10.154 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:10.155 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:09 trial187 ceph-mon[27464]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: mon.a calling monitor election 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: mon.c calling monitor election 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: monmap epoch 2 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: last_changed 2026-02-13T01:23:09.823289+0000 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: min_mon_release 20 (tentacle) 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: election_strategy: 1 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: 1: [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] mon.c 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: fsmap 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: mgrmap e8: x(active, since 24s) 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: overall HEALTH_OK 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:15.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: mon.a calling monitor election 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: mon.c calling monitor election 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: monmap epoch 2 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: last_changed 2026-02-13T01:23:09.823289+0000 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: min_mon_release 20 (tentacle) 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: election_strategy: 1 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: 1: [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] mon.c 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: fsmap 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: mgrmap e8: x(active, since 24s) 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: overall HEALTH_OK 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:15.998 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:23:15.998 INFO:teuthology.orchestra.run.trial187.stdout:{"epoch":2,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","modified":"2026-02-13T01:23:09.823289Z","created":"2026-02-13T01:22:40.089699Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:22:40:089721+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:3300","nonce":0},{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:23:09:823287+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T01:23:15.998 INFO:teuthology.orchestra.run.trial187.stderr:dumped monmap epoch 2 2026-02-13T01:23:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:15 trial187 ceph-mon[27464]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:15 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:16.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:15 trial028 ceph-mon[22984]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:16.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:15 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:16 trial134 ceph-mon[27948]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T01:23:17.055 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:23:17.055 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:23:17.171 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:23:17.195 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:23:16 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:23:16.823+0000 7f0c725a66c0 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: mon.a calling monitor election 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: mon.c calling monitor election 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: mon.b calling monitor election 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: monmap epoch 3 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: last_changed 2026-02-13T01:23:16.197837+0000 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: min_mon_release 20 (tentacle) 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: election_strategy: 1 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: 1: [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] mon.c 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: 2: [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] mon.b 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: fsmap 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: mgrmap e8: x(active, since 31s) 2026-02-13T01:23:21.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: overall HEALTH_OK 2026-02-13T01:23:21.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.632 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.632 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:21.632 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.632 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: mon.a calling monitor election 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: mon.c calling monitor election 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: mon.b calling monitor election 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: monmap epoch 3 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: last_changed 2026-02-13T01:23:16.197837+0000 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: min_mon_release 20 (tentacle) 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: election_strategy: 1 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: 1: [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] mon.c 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: 2: [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] mon.b 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: fsmap 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: mgrmap e8: x(active, since 31s) 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: overall HEALTH_OK 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.633 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.695 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.695 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:21.695 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: mon.a calling monitor election 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: mon.c calling monitor election 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: mon.b calling monitor election 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: monmap epoch 3 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: fsid 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: last_changed 2026-02-13T01:23:16.197837+0000 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: created 2026-02-13T01:22:40.089699+0000 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: min_mon_release 20 (tentacle) 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: election_strategy: 1 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: 1: [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] mon.c 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: 2: [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] mon.b 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: fsmap 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: mgrmap e8: x(active, since 31s) 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: overall HEALTH_OK 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:21.822 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:23:21.822 INFO:teuthology.orchestra.run.trial187.stdout:{"epoch":3,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","modified":"2026-02-13T01:23:16.197837Z","created":"2026-02-13T01:22:40.089699Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:22:40:089721+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:3300","nonce":0},{"type":"v1","addr":"10.20.193.187:6789","nonce":0}]},"addr":"10.20.193.187:6789/0","public_addr":"10.20.193.187:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:23:09:823287+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:3300","nonce":0},{"type":"v1","addr":"10.20.193.134:6789","nonce":0}]},"addr":"10.20.193.134:6789/0","public_addr":"10.20.193.134:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:23:16:197836+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T01:23:21.822 INFO:teuthology.orchestra.run.trial187.stderr:dumped monmap epoch 3 2026-02-13T01:23:21.864 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T01:23:21.864 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T01:23:22.049 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.359 INFO:teuthology.orchestra.run.trial028.stdout:# minimal ceph.conf for 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:22.359 INFO:teuthology.orchestra.run.trial028.stdout:[global] 2026-02-13T01:23:22.359 INFO:teuthology.orchestra.run.trial028.stdout: fsid = 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:23:22.359 INFO:teuthology.orchestra.run.trial028.stdout: mon_host = [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/1756440785' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:22.508 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T01:23:22.508 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:23:22.508 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:22.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:22.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/1756440785' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:22.565 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:23:22.565 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/1756440785' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:22.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:22.662 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:23:22.662 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:22.689 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:23:22.689 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:22.751 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:23:22.751 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:22.779 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:23:22.779 DEBUG:teuthology.orchestra.run.trial187:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:22.842 INFO:tasks.cephadm:Adding mgr.x on trial028 2026-02-13T01:23:22.842 INFO:tasks.cephadm:Adding mgr.y on trial134 2026-02-13T01:23:22.842 INFO:tasks.cephadm:Adding mgr.z on trial187 2026-02-13T01:23:22.843 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch apply mgr '3;trial028=x;trial134=y;trial187=z' 2026-02-13T01:23:22.995 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:23:23.211 INFO:teuthology.orchestra.run.trial187.stdout:Scheduled mgr update... 2026-02-13T01:23:23.249 DEBUG:teuthology.orchestra.run.trial134:mgr.y> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.y.service 2026-02-13T01:23:23.251 DEBUG:teuthology.orchestra.run.trial187:mgr.z> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.z.service 2026-02-13T01:23:23.252 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T01:23:23.252 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T01:23:23.255 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T01:23:23.255 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T01:23:23.300 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T01:23:23.300 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T01:23:23.344 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T01:23:23.344 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T01:23:23.389 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T01:23:23.390 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T01:23:23.435 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T01:23:23.436 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.441 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T01:23:23.442 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T01:23:23.487 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T01:23:23.488 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.505 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T01:23:23.506 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T01:23:23.545 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.551 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T01:23:23.551 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1697128044' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.559 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:23.559 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.559 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.559 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1697128044' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.566 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T01:23:23.566 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T01:23:23.614 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T01:23:23.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T01:23:23.620 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.623 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T01:23:23.623 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T01:23:23.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:23.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1697128044' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:23.656 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.663 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T01:23:23.663 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T01:23:23.665 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.673 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T01:23:23.673 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T01:23:23.731 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T01:23:23.731 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T01:23:23.737 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.743 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T01:23:23.743 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T01:23:23.791 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T01:23:23.792 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T01:23:23.830 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.834 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T01:23:23.834 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T01:23:23.903 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T01:23:23.903 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T01:23:23.951 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T01:23:23.951 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T01:23:23.998 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T01:23:23.998 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T01:23:24.050 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T01:23:24.051 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T01:23:24.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 -- 10.20.193.28:0/871849140 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f951803f950 msgr2=0x7f951805fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.074 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T01:23:24.074 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T01:23:24.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 --2- 10.20.193.28:0/871849140 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f951803f950 0x7f951805fe00 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9530005b40 tx=0x7f95300072a0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 -- 10.20.193.28:0/871849140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f953c1146f0 msgr2=0x7f953c0fde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 --2- 10.20.193.28:0/871849140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f953c1146f0 0x7f953c0fde60 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f952c00b6c0 tx=0x7f952c00bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:24.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 -- 10.20.193.28:0/871849140 shutdown_connections 2026-02-13T01:23:24.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 --2- 10.20.193.28:0/871849140 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f951803f950 0x7f951805fe00 unknown :-1 s=CLOSED pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 --2- 10.20.193.28:0/871849140 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f953c115120 0x7f953c0fea50 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 --2- 10.20.193.28:0/871849140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f953c1146f0 0x7f953c0fde60 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 --2- 10.20.193.28:0/871849140 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f953c113dc0 0x7f953c0fd810 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.069+0000 7f95439fc6c0 1 -- 10.20.193.28:0/871849140 >> 10.20.193.28:0/871849140 conn(0x7f953c05bd20 msgr2=0x7f953c0f3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.070+0000 7f95439fc6c0 1 -- 10.20.193.28:0/871849140 shutdown_connections 2026-02-13T01:23:24.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.071+0000 7f95439fc6c0 1 -- 10.20.193.28:0/871849140 wait complete. 2026-02-13T01:23:24.110 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T01:23:24.110 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.119 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T01:23:24.119 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T01:23:24.158 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.161 DEBUG:tasks.cephadm:set 26 configs 2026-02-13T01:23:24.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.203+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd998002e50 con 0x7fd9d005e6f0 2026-02-13T01:23:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.212+0000 7fd9c5ffb6c0 1 -- 10.20.193.28:0/2872778255 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fd9b800f880 con 0x7fd9d005e6f0 2026-02-13T01:23:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.214+0000 7fd9c5ffb6c0 1 -- 10.20.193.28:0/2872778255 <== mon.0 v2:10.20.193.28:3300/0 9 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fd9b8008da0 con 0x7fd9d005e6f0 2026-02-13T01:23:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 -- 10.20.193.28:0/2122692235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf48134920 msgr2=0x7faf48154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/2122692235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf48134920 0x7faf48154da0 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=1578092385181571906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf3c009b00 tx=0x7faf3c02eeb0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 -- 10.20.193.28:0/2122692235 shutdown_connections 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/2122692235 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf481554e0 0x7faf48175990 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/2122692235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf48134920 0x7faf48154da0 unknown :-1 s=CLOSED pgs=91 gs=3 cs=0 l=1 c_cookie=1578092385181571906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/2122692235 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48134350 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.215+0000 7faf4f5096c0 1 -- 10.20.193.28:0/2122692235 >> 10.20.193.28:0/2122692235 conn(0x7faf4805b8e0 msgr2=0x7faf4805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.216+0000 7faf4f5096c0 1 -- 10.20.193.28:0/2122692235 shutdown_connections 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.216+0000 7faf4f5096c0 1 -- 10.20.193.28:0/2122692235 wait complete. 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.217+0000 7faf4f5096c0 1 Processor -- start 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.217+0000 7faf4f5096c0 1 -- start start 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4f5096c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4f5096c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 0x7faf48154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4f5096c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf481554e0 0x7faf480fd7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4f5096c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf480fdf50 con 0x7faf481554e0 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4f5096c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7faf480fe0c0 con 0x7faf48134920 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4f5096c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7faf480fe720 con 0x7faf48113f70 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4da7b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf481554e0 0x7faf480fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4d27a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4d27a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53246/0 (socket says 10.20.193.28:53246) 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4d27a6c0 1 -- 10.20.193.28:0/4135419011 learned_addr learned my addr 10.20.193.28:0/4135419011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4ca796c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 0x7faf48154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4d27a6c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 msgr2=0x7faf48175970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4d27a6c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 msgr2=0x7faf48175970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4ca796c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 msgr2=0x7faf48154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4ca796c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 msgr2=0x7faf48154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4ca796c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 0x7faf48154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4ca796c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 0x7faf48154d40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.218+0000 7faf4d27a6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4d27a6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4da7b6c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 msgr2=0x7faf48175970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4da7b6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4da7b6c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 msgr2=0x7faf48154d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4da7b6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 0x7faf48154d40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.219+0000 7faf4da7b6c0 1 -- 10.20.193.28:0/4135419011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c0094c0 con 0x7faf481554e0 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.220+0000 7faf4da7b6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf481554e0 0x7faf480fd7c0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf44006f60 tx=0x7faf4400abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.220+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf44005b60 con 0x7faf481554e0 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.220+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf480fea00 con 0x7faf481554e0 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.220+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf480feee0 con 0x7faf481554e0 2026-02-13T01:23:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.221+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7faf4400a030 con 0x7faf481554e0 2026-02-13T01:23:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.221+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf440064e0 con 0x7faf481554e0 2026-02-13T01:23:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.221+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf48178db0 con 0x7faf481554e0 2026-02-13T01:23:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.222+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7faf44006670 con 0x7faf481554e0 2026-02-13T01:23:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.222+0000 7faf367fc6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faf2003f8f0 0x7faf2005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.223+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7faf44005ed0 con 0x7faf481554e0 2026-02-13T01:23:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.225+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faf44008550 con 0x7faf481554e0 2026-02-13T01:23:24.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.266+0000 7faf4d27a6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faf2003f8f0 0x7faf2005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.266+0000 7faf4d27a6c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faf2003f8f0 0x7faf2005fda0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf38007240 tx=0x7faf38007620 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/3725055839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc134770 msgr2=0x7f97dc154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 --2- 10.20.193.28:0/3725055839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc134770 0x7f97dc154bd0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=1176277501026949200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97cc0075a0 tx=0x7f97cc02fda0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/3725055839 shutdown_connections 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 --2- 10.20.193.28:0/3725055839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc155310 0x7f97dc1757c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 --2- 10.20.193.28:0/3725055839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc134770 0x7f97dc154bd0 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=1176277501026949200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 --2- 10.20.193.28:0/3725055839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc113dc0 0x7f97dc1341a0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.264+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/3725055839 >> 10.20.193.28:0/3725055839 conn(0x7f97dc05b700 msgr2=0x7f97dc05bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.265+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/3725055839 shutdown_connections 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.265+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/3725055839 wait complete. 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.266+0000 7f97e1ed06c0 1 Processor -- start 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.266+0000 7f97e1ed06c0 1 -- start start 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97e1ed06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc113dc0 0x7f97dc154b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97e1ed06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 0x7f97dc16d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97e1ed06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97e1ed06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc16e430 con 0x7f97dc113dc0 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97e1ed06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc16e5a0 con 0x7f97dc155310 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97e1ed06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc16e760 con 0x7f97dc134770 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97db7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97daffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 0x7f97dc16d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97db7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33198/0 (socket says 10.20.193.28:33198) 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.267+0000 7f97db7fe6c0 1 -- 10.20.193.28:0/858270899 learned_addr learned my addr 10.20.193.28:0/858270899 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97db7fe6c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 msgr2=0x7f97dc16d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97db7fe6c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 msgr2=0x7f97dc16d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97db7fe6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97db7fe6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97daffd6c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 msgr2=0x7f97dc16d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97daffd6c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 msgr2=0x7f97dc16d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97daffd6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 0x7f97dc16d070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97daffd6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 0x7f97dc16d070 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.268+0000 7f97e0c476c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc113dc0 0x7f97dc154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.269+0000 7f97e0c476c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 msgr2=0x7f97dc16d070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.269+0000 7f97e0c476c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 0x7f97dc16d070 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.269+0000 7f97e0c476c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 msgr2=0x7f97dc16d7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.269+0000 7f97e0c476c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.269+0000 7f97e0c476c0 1 -- 10.20.193.28:0/858270899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0071c0 con 0x7f97dc113dc0 2026-02-13T01:23:24.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.269+0000 7f97e0c476c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc113dc0 0x7f97dc154b90 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c8004750 tx=0x7f97c800bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.285 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.285 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd9ac03f8f0 msgr2=0x7fd9ac05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7fd9d5c246c0 1 --2- 10.20.193.28:0/2872778255 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd9ac03f8f0 0x7fd9ac05fda0 secure :-1 s=READY pgs=49 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9c00098a0 tx=0x7fd9c00023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd9d005e6f0 msgr2=0x7fd9d00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c8002ba0 con 0x7f97dc113dc0 2026-02-13T01:23:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f97c80044f0 con 0x7f97dc113dc0 2026-02-13T01:23:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97c800dd40 con 0x7f97dc113dc0 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/858270899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc16ea40 con 0x7f97dc113dc0 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7f97e1ed06c0 1 -- 10.20.193.28:0/858270899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc16eed0 con 0x7f97dc113dc0 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c005310 con 0x7f97dc113dc0 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.301+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f97c8002d00 con 0x7f97dc113dc0 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.302+0000 7f97d8ff96c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f97a403f940 0x7f97a405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.302+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f97c80110a0 con 0x7f97dc113dc0 2026-02-13T01:23:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.306+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f97c8005020 con 0x7f97dc113dc0 2026-02-13T01:23:24.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.313+0000 7f97daffd6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f97a403f940 0x7f97a405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.313 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.315+0000 7f97daffd6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f97a403f940 0x7f97a405fdf0 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97cc0074f0 tx=0x7f97cc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.299+0000 7fd9d5c246c0 1 --2- 10.20.193.28:0/2872778255 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd9d005e6f0 0x7fd9d00fee90 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9b8005980 tx=0x7fd9b800be00 comp rx=0 tx=0).stop 2026-02-13T01:23:24.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 shutdown_connections 2026-02-13T01:23:24.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 --2- 10.20.193.28:0/2872778255 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd9ac03f8f0 0x7fd9ac05fda0 unknown :-1 s=CLOSED pgs=49 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 --2- 10.20.193.28:0/2872778255 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd9d0114eb0 0x7fd9d01000d0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 --2- 10.20.193.28:0/2872778255 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd9d0114300 0x7fd9d00ff4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 --2- 10.20.193.28:0/2872778255 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd9d005e6f0 0x7fd9d00fee90 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 >> 10.20.193.28:0/2872778255 conn(0x7fd9d005bb70 msgr2=0x7fd9d00f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 shutdown_connections 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.300+0000 7fd9d5c246c0 1 -- 10.20.193.28:0/2872778255 wait complete. 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.316+0000 7f6355ce46c0 1 -- 10.20.193.28:0/1143991432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6350113dc0 msgr2=0x7f63501341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.316+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/1143991432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6350113dc0 0x7f63501341a0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=2889425577668330552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400098a0 tx=0x7f634002ec40 comp rx=0 tx=0).stop 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 -- 10.20.193.28:0/1143991432 shutdown_connections 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/1143991432 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f63501347c0 0x7f6350154c00 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/1143991432 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6350155340 0x7f63501757f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/1143991432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6350113dc0 0x7f63501341a0 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=2889425577668330552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 -- 10.20.193.28:0/1143991432 >> 10.20.193.28:0/1143991432 conn(0x7f635005b720 msgr2=0x7f635005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 -- 10.20.193.28:0/1143991432 shutdown_connections 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.317+0000 7f6355ce46c0 1 -- 10.20.193.28:0/1143991432 wait complete. 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.318+0000 7f6355ce46c0 1 Processor -- start 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.318+0000 7f6355ce46c0 1 -- start start 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6355ce46c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6350113dc0 0x7f63501757d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6355ce46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 0x7f6350154c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6355ce46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6350155340 0x7f63500f6bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6355ce46c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63500f71f0 con 0x7f63501347c0 2026-02-13T01:23:24.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6355ce46c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63500f7360 con 0x7f6350113dc0 2026-02-13T01:23:24.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6355ce46c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f63500f7520 con 0x7f6350155340 2026-02-13T01:23:24.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f6354ce26c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6350113dc0 0x7f63501757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f634ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 0x7f6350154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f634ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 0x7f6350154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51012/0 (socket says 10.20.193.28:51012) 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.319+0000 7f634ffff6c0 1 -- 10.20.193.28:0/2166089927 learned_addr learned my addr 10.20.193.28:0/2166089927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.320+0000 7f634ffff6c0 1 -- 10.20.193.28:0/2166089927 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6350155340 msgr2=0x7f63500f6bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.320+0000 7f634ffff6c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6350155340 0x7f63500f6bf0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.320+0000 7f634ffff6c0 1 -- 10.20.193.28:0/2166089927 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6350113dc0 msgr2=0x7f63501757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.320+0000 7f634ffff6c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6350113dc0 0x7f63501757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.320+0000 7f634ffff6c0 1 -- 10.20.193.28:0/2166089927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400094c0 con 0x7f63501347c0 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.320+0000 7f634ffff6c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 0x7f6350154c00 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f633c005980 tx=0x7f633c00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.321+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f633c004250 con 0x7f63501347c0 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.321+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f633c00be30 con 0x7f63501347c0 2026-02-13T01:23:24.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.321+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f633c011070 con 0x7f63501347c0 2026-02-13T01:23:24.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.321+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63500f7800 con 0x7f63501347c0 2026-02-13T01:23:24.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.321+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63501058e0 con 0x7f63501347c0 2026-02-13T01:23:24.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.322+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63500f7ac0 con 0x7f63501347c0 2026-02-13T01:23:24.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.323+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f633c0028c0 con 0x7f63501347c0 2026-02-13T01:23:24.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.323+0000 7f634dffb6c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f632403f940 0x7f632405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.325+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f633c002ba0 con 0x7f63501347c0 2026-02-13T01:23:24.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.326+0000 7f6354ce26c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f632403f940 0x7f632405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.326+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f633c00f040 con 0x7f63501347c0 2026-02-13T01:23:24.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.329+0000 7f6354ce26c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f632403f940 0x7f632405fdf0 secure :-1 s=READY pgs=52 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400097f0 tx=0x7f63400023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.345 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.354 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.375 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.399+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7faf100051e0 con 0x7faf481554e0 2026-02-13T01:23:24.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.438+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7faf4400b8d0 con 0x7faf481554e0 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.439+0000 7faf367fc6c0 1 -- 10.20.193.28:0/4135419011 <== mon.0 v2:10.20.193.28:3300/0 8 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faf44051bc0 con 0x7faf481554e0 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.443+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faf2003f8f0 msgr2=0x7faf2005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.443+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faf2003f8f0 0x7faf2005fda0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf38007240 tx=0x7faf38007620 comp rx=0 tx=0).stop 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.443+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf481554e0 msgr2=0x7faf480fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.443+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf481554e0 0x7faf480fd7c0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf44006f60 tx=0x7faf4400abe0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 shutdown_connections 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf481554e0 0x7faf480fd7c0 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faf48134920 0x7faf48154d40 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faf2003f8f0 0x7faf2005fda0 unknown :-1 s=CLOSED pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 --2- 10.20.193.28:0/4135419011 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faf48113f70 0x7faf48175970 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 >> 10.20.193.28:0/4135419011 conn(0x7faf4805b8e0 msgr2=0x7faf480f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 shutdown_connections 2026-02-13T01:23:24.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.444+0000 7faf4f5096c0 1 -- 10.20.193.28:0/4135419011 wait complete. 2026-02-13T01:23:24.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.432+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f979c005b40 con 0x7f97dc113dc0 2026-02-13T01:23:24.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.438+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f97c8004e90 con 0x7f97dc113dc0 2026-02-13T01:23:24.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.442+0000 7f97d8ff96c0 1 -- 10.20.193.28:0/858270899 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f97c80088d0 con 0x7f97dc113dc0 2026-02-13T01:23:24.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.436+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f63500f7ac0 con 0x7f63501347c0 2026-02-13T01:23:24.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.439+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f633c050a30 con 0x7f63501347c0 2026-02-13T01:23:24.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.445+0000 7f634dffb6c0 1 -- 10.20.193.28:0/2166089927 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f63500f7ac0 con 0x7f63501347c0 2026-02-13T01:23:24.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f97a403f940 msgr2=0x7f97a405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f97a403f940 0x7f97a405fdf0 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97cc0074f0 tx=0x7f97cc0023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc113dc0 msgr2=0x7f97dc154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc113dc0 0x7f97dc154b90 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c8004750 tx=0x7f97c800bae0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 shutdown_connections 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f97a403f940 0x7f97a405fdf0 unknown :-1 s=CLOSED pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f97dc134770 0x7f97dc16d070 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f97dc155310 0x7f97dc16d7c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 --2- 10.20.193.28:0/858270899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f97dc113dc0 0x7f97dc154b90 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 >> 10.20.193.28:0/858270899 conn(0x7f97dc05b700 msgr2=0x7f97dc0f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 shutdown_connections 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.447+0000 7f97be7fc6c0 1 -- 10.20.193.28:0/858270899 wait complete. 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f632403f940 msgr2=0x7f632405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f632403f940 0x7f632405fdf0 secure :-1 s=READY pgs=52 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400097f0 tx=0x7f63400023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 msgr2=0x7f6350154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 0x7f6350154c00 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f633c005980 tx=0x7f633c00bbd0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 shutdown_connections 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f632403f940 0x7f632405fdf0 unknown :-1 s=CLOSED pgs=52 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.449+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6350155340 0x7f63500f6bf0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.450+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63501347c0 0x7f6350154c00 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.450+0000 7f6355ce46c0 1 --2- 10.20.193.28:0/2166089927 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6350113dc0 0x7f63501757d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.450+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 >> 10.20.193.28:0/2166089927 conn(0x7f635005b720 msgr2=0x7f63500f86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.450+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 shutdown_connections 2026-02-13T01:23:24.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.450+0000 7f6355ce46c0 1 -- 10.20.193.28:0/2166089927 wait complete. 2026-02-13T01:23:24.475 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.496 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.511 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.565 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial134=y;trial187=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1523831151' entity='client.admin' 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3654451758' entity='client.admin' 2026-02-13T01:23:24.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/871849140' entity='client.admin' 2026-02-13T01:23:24.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2872778255' entity='client.admin' 2026-02-13T01:23:24.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4135419011' entity='client.admin' 2026-02-13T01:23:24.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/858270899' entity='client.admin' 2026-02-13T01:23:24.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2166089927' entity='client.admin' 2026-02-13T01:23:24.600 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.601 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.639 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.661 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.696+0000 7f33fffff6c0 1 -- 10.20.193.28:0/272456601 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33f8004560 con 0x7f34081562a0 2026-02-13T01:23:24.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.696+0000 7f340f5a36c0 1 -- 10.20.193.28:0/272456601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34081562a0 msgr2=0x7f3408176680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.696+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/272456601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34081562a0 0x7f3408176680 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=13763027424018594264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f8009970 tx=0x7f33f802ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:24.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.699+0000 7f340f5a36c0 1 -- 10.20.193.28:0/272456601 shutdown_connections 2026-02-13T01:23:24.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.699+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/272456601 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3408135980 0x7f3408155d60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.699+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/272456601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34081562a0 0x7f3408176680 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=13763027424018594264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.699+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/272456601 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408055ca0 0x7f3408113f70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.699+0000 7f340f5a36c0 1 -- 10.20.193.28:0/272456601 >> 10.20.193.28:0/272456601 conn(0x7f340805bd20 msgr2=0x7f340805c140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.702+0000 7f340f5a36c0 1 -- 10.20.193.28:0/272456601 shutdown_connections 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.702+0000 7f340f5a36c0 1 -- 10.20.193.28:0/272456601 wait complete. 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.702+0000 7f340f5a36c0 1 Processor -- start 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 -- start start 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 0x7f3408155d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 0x7f3408176680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 0x7f3408103b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3408104290 con 0x7f3408055ca0 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3408104400 con 0x7f3408135980 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340f5a36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3408104a20 con 0x7f34081562a0 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340d3146c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 0x7f3408155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340cb136c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 0x7f3408176680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340d3146c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 0x7f3408155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51034/0 (socket says 10.20.193.28:51034) 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340d3146c0 1 -- 10.20.193.28:0/2061368316 learned_addr learned my addr 10.20.193.28:0/2061368316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.703+0000 7f340db156c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 0x7f3408103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340cb136c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 msgr2=0x7f3408176680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340cb136c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 msgr2=0x7f3408176680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340cb136c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 0x7f3408176680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340cb136c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 0x7f3408176680 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340db156c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 msgr2=0x7f3408103b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340db156c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 msgr2=0x7f3408103b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340db156c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 0x7f3408103b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340db156c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 0x7f3408103b00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340d3146c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 msgr2=0x7f3408103b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340d3146c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 0x7f3408103b00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340d3146c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 msgr2=0x7f3408176680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340d3146c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 0x7f3408176680 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340d3146c0 1 -- 10.20.193.28:0/2061368316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f8009590 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340d3146c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 0x7f3408155d60 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f340400c6c0 tx=0x7f340400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3404003ce0 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3408104d00 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.704+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081052b0 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.705+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3404003e40 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.705+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3404010070 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.705+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408178570 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.706+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3404010240 con 0x7f3408055ca0 2026-02-13T01:23:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.706+0000 7f33fe7fc6c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33e403f8f0 0x7f33e405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.706+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3404052260 con 0x7f3408055ca0 2026-02-13T01:23:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.707+0000 7f340cb136c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33e403f8f0 0x7f33e405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.707+0000 7f340cb136c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33e403f8f0 0x7f33e405fda0 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f0004790 tx=0x7f33f0006f30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.709+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3404004030 con 0x7f3408055ca0 2026-02-13T01:23:24.711 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.713 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55ceffd6c0 1 -- 10.20.193.28:0/4051291626 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55bc02fd40 con 0x7f55d005ebe0 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55d55066c0 1 -- 10.20.193.28:0/4051291626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d005ebe0 msgr2=0x7f55d010b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55d55066c0 1 --2- 10.20.193.28:0/4051291626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d005ebe0 0x7f55d010b090 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=1682478370677441982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55bc0098a0 tx=0x7f55bc02ec60 comp rx=0 tx=0).stop 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55d55066c0 1 -- 10.20.193.28:0/4051291626 shutdown_connections 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55d55066c0 1 --2- 10.20.193.28:0/4051291626 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d010c210 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55d55066c0 1 --2- 10.20.193.28:0/4051291626 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d010ba40 0x7f55d010c750 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.731+0000 7f55d55066c0 1 --2- 10.20.193.28:0/4051291626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d005ebe0 0x7f55d010b090 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=1682478370677441982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.732+0000 7f55d55066c0 1 -- 10.20.193.28:0/4051291626 >> 10.20.193.28:0/4051291626 conn(0x7f55d00e8770 msgr2=0x7f55d0108bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.732+0000 7f55d55066c0 1 -- 10.20.193.28:0/4051291626 shutdown_connections 2026-02-13T01:23:24.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.732+0000 7f55d55066c0 1 -- 10.20.193.28:0/4051291626 wait complete. 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.732+0000 7f55d55066c0 1 Processor -- start 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.733+0000 7f55d55066c0 1 -- start start 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.733+0000 7f55d55066c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.733+0000 7f55d55066c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d00ece80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.733+0000 7f55d55066c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d00eda70 0x7f55d00edf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55d55066c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f55d00ee510 con 0x7f55d00eda70 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55d4d056c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d00eda70 0x7f55d00edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.733+0000 7f55cffff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cffff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33242/0 (socket says 10.20.193.28:33242) 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cffff6c0 1 -- 10.20.193.28:0/2893409439 learned_addr learned my addr 10.20.193.28:0/2893409439 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55d55066c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55d00ee680 con 0x7f55d005ebe0 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55d55066c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f55d00ee840 con 0x7f55d010b5d0 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cf7fe6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d00ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cf7fe6c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 msgr2=0x7f55d00ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cf7fe6c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 msgr2=0x7f55d00ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cf7fe6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d00ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cf7fe6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d00ece80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cffff6c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 msgr2=0x7f55d00ec830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cffff6c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 msgr2=0x7f55d00ec830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cffff6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.734+0000 7f55cffff6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.735+0000 7f55d4d056c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 msgr2=0x7f55d00ece80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.735+0000 7f55d4d056c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d00ece80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.735+0000 7f55d4d056c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 msgr2=0x7f55d00ec830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.735+0000 7f55d4d056c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.735+0000 7f55d4d056c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc0094c0 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.736+0000 7f55d4d056c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d00eda70 0x7f55d00edf10 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55c4006090 tx=0x7f55c4006560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.736+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55c4003c40 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.736+0000 7f55d55066c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d00eeba0 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.737+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f55c4006820 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.737+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55c400de40 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.737+0000 7f55d55066c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d00ef0d0 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.738+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5598005310 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.738+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f55c4005030 con 0x7f55d00eda70 2026-02-13T01:23:24.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.739+0000 7f55cd7fa6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55a403f8f0 0x7f55a405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.739+0000 7f55cffff6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55a403f8f0 0x7f55a405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.740+0000 7f55cffff6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55a403f8f0 0x7f55a405fda0 secure :-1 s=READY pgs=54 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55bc02fa00 tx=0x7f55bc02ff70 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.740+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f55c4012500 con 0x7f55d00eda70 2026-02-13T01:23:24.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.741+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f55c4010750 con 0x7f55d00eda70 2026-02-13T01:23:24.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial134=y;trial187=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:24.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:24.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:24.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1523831151' entity='client.admin' 2026-02-13T01:23:24.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:24.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:24.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:24.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3654451758' entity='client.admin' 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/871849140' entity='client.admin' 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2872778255' entity='client.admin' 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4135419011' entity='client.admin' 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/858270899' entity='client.admin' 2026-02-13T01:23:24.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2166089927' entity='client.admin' 2026-02-13T01:23:24.812 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.818 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 -- 10.20.193.28:0/1218223397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed805d8b0 msgr2=0x7f5ed8175df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 --2- 10.20.193.28:0/1218223397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed805d8b0 0x7f5ed8175df0 secure :-1 s=READY pgs=103 gs=3 cs=0 l=1 c_cookie=4075363652433697521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ecc009970 tx=0x7f5ecc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 -- 10.20.193.28:0/1218223397 shutdown_connections 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 --2- 10.20.193.28:0/1218223397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed805d8b0 0x7f5ed8175df0 unknown :-1 s=CLOSED pgs=103 gs=3 cs=0 l=1 c_cookie=4075363652433697521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 --2- 10.20.193.28:0/1218223397 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8134920 0x7f5ed8154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 --2- 10.20.193.28:0/1218223397 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed8113f70 0x7f5ed8134350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 -- 10.20.193.28:0/1218223397 >> 10.20.193.28:0/1218223397 conn(0x7f5ed805b8e0 msgr2=0x7f5ed805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.822+0000 7f5edec306c0 1 -- 10.20.193.28:0/1218223397 shutdown_connections 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.823+0000 7f5edec306c0 1 -- 10.20.193.28:0/1218223397 wait complete. 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.824+0000 7f5edec306c0 1 Processor -- start 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.824+0000 7f5edec306c0 1 -- start start 2026-02-13T01:23:24.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.824+0000 7f5edec306c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8113f70 0x7f5ed8154da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.824+0000 7f5edec306c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8134920 0x7f5ed8175d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.824+0000 7f5edec306c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed811caa0 0x7f5ed811cf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edc9a16c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8113f70 0x7f5ed8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edc9a16c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8113f70 0x7f5ed8154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33270/0 (socket says 10.20.193.28:33270) 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edc9a16c0 1 -- 10.20.193.28:0/2279839610 learned_addr learned my addr 10.20.193.28:0/2279839610 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed811db50 con 0x7f5ed8134920 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed811dcc0 con 0x7f5ed8113f70 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed811de80 con 0x7f5ed811caa0 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.825+0000 7f5edd1a26c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed811caa0 0x7f5ed811cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.826+0000 7f5edd1a26c0 1 -- 10.20.193.28:0/2279839610 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8113f70 msgr2=0x7f5ed8154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.826+0000 7f5edd1a26c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8113f70 0x7f5ed8154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.826+0000 7f5edd1a26c0 1 -- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8134920 msgr2=0x7f5ed8175d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.826+0000 7f5edd1a26c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8134920 0x7f5ed8175d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.826+0000 7f5edd1a26c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc009590 con 0x7f5ed811caa0 2026-02-13T01:23:24.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.826+0000 7f5edd1a26c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed811caa0 0x7f5ed811cf40 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ecc005980 tx=0x7f5ecc004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.829 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:24.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.828+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ecc0028d0 con 0x7f5ed811caa0 2026-02-13T01:23:24.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.828+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ecc031030 con 0x7f5ed811caa0 2026-02-13T01:23:24.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.828+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ecc007440 con 0x7f5ed811caa0 2026-02-13T01:23:24.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.828+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed811e100 con 0x7f5ed811caa0 2026-02-13T01:23:24.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.828+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed811e500 con 0x7f5ed811caa0 2026-02-13T01:23:24.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.829+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f5ecc002a30 con 0x7f5ed811caa0 2026-02-13T01:23:24.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.830+0000 7f5ed5ffb6c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f5eac03f8c0 0x7f5eac05fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.830+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f5ecc0751b0 con 0x7f5ed811caa0 2026-02-13T01:23:24.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.830+0000 7f5edc9a16c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f5eac03f8c0 0x7f5eac05fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.831+0000 7f5edc9a16c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f5eac03f8c0 0x7f5eac05fd70 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec4006fd0 tx=0x7f5ec400a310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.854+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f3408179200 con 0x7f3408055ca0 2026-02-13T01:23:24.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.856+0000 7f33fe7fc6c0 1 -- 10.20.193.28:0/2061368316 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v16)=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f3404013030 con 0x7f3408055ca0 2026-02-13T01:23:24.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33e403f8f0 msgr2=0x7f33e405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33e403f8f0 0x7f33e405fda0 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33f0004790 tx=0x7f33f0006f30 comp rx=0 tx=0).stop 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 msgr2=0x7f3408155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 0x7f3408155d60 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f340400c6c0 tx=0x7f340400cb90 comp rx=0 tx=0).stop 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 shutdown_connections 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33e403f8f0 0x7f33e405fda0 unknown :-1 s=CLOSED pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f34081562a0 0x7f3408103b00 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3408135980 0x7f3408176680 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 --2- 10.20.193.28:0/2061368316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3408055ca0 0x7f3408155d60 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 >> 10.20.193.28:0/2061368316 conn(0x7f340805bd20 msgr2=0x7f340817b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 shutdown_connections 2026-02-13T01:23:24.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.863+0000 7f340f5a36c0 1 -- 10.20.193.28:0/2061368316 wait complete. 2026-02-13T01:23:24.893 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:24 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:24.750+0000 7fd1d8a77fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:23:24.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial134=y;trial187=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:24.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:24.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:24.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1523831151' entity='client.admin' 2026-02-13T01:23:24.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3654451758' entity='client.admin' 2026-02-13T01:23:24.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/871849140' entity='client.admin' 2026-02-13T01:23:24.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2872778255' entity='client.admin' 2026-02-13T01:23:24.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4135419011' entity='client.admin' 2026-02-13T01:23:24.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/858270899' entity='client.admin' 2026-02-13T01:23:24.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2166089927' entity='client.admin' 2026-02-13T01:23:24.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.895+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea4005310 con 0x7f5ed811caa0 2026-02-13T01:23:24.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.901+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5ecc002d10 con 0x7f5ed811caa0 2026-02-13T01:23:24.904 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.905 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.905 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial028') 2026-02-13T01:23:24.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.929+0000 7f8607fff6c0 1 -- 10.20.193.28:0/3062437620 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810ac40 msgr2=0x7f860810b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.929+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/3062437620 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810ac40 0x7f860810b030 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=5847926800206913922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc0075a0 tx=0x7f85fc02fe80 comp rx=0 tx=0).stop 2026-02-13T01:23:24.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.933+0000 7f8607fff6c0 1 -- 10.20.193.28:0/3062437620 shutdown_connections 2026-02-13T01:23:24.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.933+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/3062437620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 0x7f860816d100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.933+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/3062437620 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810bdc0 0x7f860810c230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.933+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/3062437620 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810ac40 0x7f860810b030 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=5847926800206913922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.933+0000 7f8607fff6c0 1 -- 10.20.193.28:0/3062437620 >> 10.20.193.28:0/3062437620 conn(0x7f86080e8320 msgr2=0x7f8608108770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.934+0000 7f8607fff6c0 1 -- 10.20.193.28:0/3062437620 shutdown_connections 2026-02-13T01:23:24.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.934+0000 7f8607fff6c0 1 -- 10.20.193.28:0/3062437620 wait complete. 2026-02-13T01:23:24.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.935+0000 7f8607fff6c0 1 Processor -- start 2026-02-13T01:23:24.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.935+0000 7f8607fff6c0 1 -- start start 2026-02-13T01:23:24.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.935+0000 7f8607fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 0x7f86080f4d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.935+0000 7f8607fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810bdc0 0x7f860816d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.934+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f5598005b40 con 0x7f55d00eda70 2026-02-13T01:23:24.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.935+0000 7f8606ffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 0x7f86080f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.935+0000 7f8606ffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 0x7f86080f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33298/0 (socket says 10.20.193.28:33298) 2026-02-13T01:23:24.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f86067fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810bdc0 0x7f860816d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f86067fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810bdc0 0x7f860816d100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53364/0 (socket says 10.20.193.28:53364) 2026-02-13T01:23:24.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8607fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 0x7f86080f55d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8607fff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f86080f61b0 con 0x7f860810c770 2026-02-13T01:23:24.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f55cd7fa6c0 1 -- 10.20.193.28:0/2893409439 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7f55c4011880 con 0x7f55d00eda70 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8606ffd6c0 1 -- 10.20.193.28:0/2733861533 learned_addr learned my addr 10.20.193.28:0/2733861533 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f86080f6320 con 0x7f860810ac40 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f86080f64e0 con 0x7f860810bdc0 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f86077fe6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 0x7f86080f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8606ffd6c0 1 -- 10.20.193.28:0/2733861533 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810bdc0 msgr2=0x7f860816d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8606ffd6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810bdc0 0x7f860816d100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.936+0000 7f8606ffd6c0 1 -- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 msgr2=0x7f86080f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f8606ffd6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 0x7f86080f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f8606ffd6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f800a5b0 con 0x7f860810ac40 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f86077fe6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 0x7f86080f55d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f8606ffd6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 0x7f86080f4d70 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc00ac90 tx=0x7f85fc0042d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85fc030b10 con 0x7f860810ac40 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85fc0071c0 con 0x7f860810ac40 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86080f6aa0 con 0x7f860810ac40 2026-02-13T01:23:24.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f85fc030c70 con 0x7f860810ac40 2026-02-13T01:23:24.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.938+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85fc0364f0 con 0x7f860810ac40 2026-02-13T01:23:24.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86080f6d80 con 0x7f860810ac40 2026-02-13T01:23:24.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55a403f8f0 msgr2=0x7f55a405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55a403f8f0 0x7f55a405fda0 secure :-1 s=READY pgs=54 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55bc02fa00 tx=0x7f55bc02ff70 comp rx=0 tx=0).stop 2026-02-13T01:23:24.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d00eda70 msgr2=0x7f55d00edf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d00eda70 0x7f55d00edf10 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55c4006090 tx=0x7f55c4006560 comp rx=0 tx=0).stop 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 shutdown_connections 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55a403f8f0 0x7f55a405fda0 unknown :-1 s=CLOSED pgs=54 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f55d010b5d0 0x7f55d00ece80 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55d00eda70 0x7f55d00edf10 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 --2- 10.20.193.28:0/2893409439 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f55d005ebe0 0x7f55d00ec830 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 >> 10.20.193.28:0/2893409439 conn(0x7f55d00e8770 msgr2=0x7f55d0058b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.940+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 shutdown_connections 2026-02-13T01:23:24.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.940+0000 7f55a2ffd6c0 1 -- 10.20.193.28:0/2893409439 wait complete. 2026-02-13T01:23:24.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.939+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f85fc00a030 con 0x7f860810ac40 2026-02-13T01:23:24.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.940+0000 7f85e7fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85dc03f8f0 0x7f85dc05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.940+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f85fc075530 con 0x7f860810ac40 2026-02-13T01:23:24.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.941+0000 7f86067fc6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85dc03f8f0 0x7f85dc05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.941+0000 7f86067fc6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85dc03f8f0 0x7f85dc05fda0 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85f0004750 tx=0x7f85f0009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.943+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f85fc030de0 con 0x7f860810ac40 2026-02-13T01:23:24.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.998+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/1322393454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c3b50 msgr2=0x7fdf0c0c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:24.998+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/1322393454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0c3f40 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=11432126609638820954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0800aa40 tx=0x7fdf0802fdf0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/1322393454 shutdown_connections 2026-02-13T01:23:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/1322393454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c54c0 0x7fdf0c0c5e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/1322393454 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdf0c0c4b10 0x7fdf0c0c4f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/1322393454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0c3f40 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=11432126609638820954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/1322393454 >> 10.20.193.28:0/1322393454 conn(0x7fdf0c0a1260 msgr2=0x7fdf0c0c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/1322393454 shutdown_connections 2026-02-13T01:23:25.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.002+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/1322393454 wait complete. 2026-02-13T01:23:25.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.009+0000 7fdf1a5746c0 1 Processor -- start 2026-02-13T01:23:25.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.009+0000 7fdf1a5746c0 1 -- start start 2026-02-13T01:23:25.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.009+0000 7fdf1a5746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0abd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.010+0000 7fdf1a5746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c4b10 0x7fdf0c0ac370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.010+0000 7fdf1a5746c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdf0c0c54c0 0x7fdf0c0acf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.010+0000 7fdf18d716c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.010+0000 7fdf18d716c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51086/0 (socket says 10.20.193.28:51086) 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf1a5746c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c0ad660 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf1a5746c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c0ad7d0 con 0x7fdf0c0c54c0 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf1a5746c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c0ad990 con 0x7fdf0c0c4b10 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf18d716c0 1 -- 10.20.193.28:0/2839445035 learned_addr learned my addr 10.20.193.28:0/2839445035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf13fff6c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c4b10 0x7fdf0c0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf195726c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdf0c0c54c0 0x7fdf0c0acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf18d716c0 1 -- 10.20.193.28:0/2839445035 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c4b10 msgr2=0x7fdf0c0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf18d716c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c4b10 0x7fdf0c0ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf18d716c0 1 -- 10.20.193.28:0/2839445035 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdf0c0c54c0 msgr2=0x7fdf0c0acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf18d716c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdf0c0c54c0 0x7fdf0c0acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.011+0000 7fdf18d716c0 1 -- 10.20.193.28:0/2839445035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0800a660 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.012+0000 7fdf13fff6c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c4b10 0x7fdf0c0ac370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.012+0000 7fdf18d716c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0abd20 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf08030a90 tx=0x7fdf080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.012+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf08003a30 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.012+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdf08003b90 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.014+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf080322d0 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.014+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c0adc10 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.014+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c0ae180 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.018+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c0adda0 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.019+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fdf08003d00 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.019+0000 7fdf127fc6c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdeec03f870 0x7fdeec05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.024+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fdf080767f0 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.025+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdf08036690 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.030+0000 7fdf13fff6c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdeec03f870 0x7fdeec05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.020+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f5ea40055c0 con 0x7f5ed811caa0 2026-02-13T01:23:25.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.034+0000 7fdf13fff6c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdeec03f870 0x7fdeec05fd20 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef8005980 tx=0x7fdef8005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.038+0000 7f5ed5ffb6c0 1 -- 10.20.193.28:0/2279839610 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f5ecc0358d0 con 0x7f5ed811caa0 2026-02-13T01:23:25.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f5eac03f8c0 msgr2=0x7f5eac05fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f5eac03f8c0 0x7f5eac05fd70 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ec4006fd0 tx=0x7f5ec400a310 comp rx=0 tx=0).stop 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed811caa0 msgr2=0x7f5ed811cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed811caa0 0x7f5ed811cf40 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ecc005980 tx=0x7f5ecc004570 comp rx=0 tx=0).stop 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 shutdown_connections 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f5eac03f8c0 0x7f5eac05fd70 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5ed811caa0 0x7f5ed811cf40 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8134920 0x7f5ed8175d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 --2- 10.20.193.28:0/2279839610 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5ed8113f70 0x7f5ed8154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.046+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 >> 10.20.193.28:0/2279839610 conn(0x7f5ed805b8e0 msgr2=0x7f5ed817be30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.047+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 shutdown_connections 2026-02-13T01:23:25.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.047+0000 7f5edec306c0 1 -- 10.20.193.28:0/2279839610 wait complete. 2026-02-13T01:23:25.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.122+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f8608170db0 con 0x7f860810ac40 2026-02-13T01:23:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.129+0000 7f85e7fff6c0 1 -- 10.20.193.28:0/2733861533 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f85fc030de0 con 0x7f860810ac40 2026-02-13T01:23:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.129+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/1982618379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 msgr2=0x7f1e101757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.129+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/1982618379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e101757f0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=12974817396162991754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e00006fd0 tx=0x7f1e00030eb0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/1982618379 shutdown_connections 2026-02-13T01:23:25.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/1982618379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e101757f0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=12974817396162991754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/1982618379 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1e101347c0 0x7f1e10154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/1982618379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 0x7f1e101341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/1982618379 >> 10.20.193.28:0/1982618379 conn(0x7f1e1005b720 msgr2=0x7f1e1005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/1982618379 shutdown_connections 2026-02-13T01:23:25.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.131+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/1982618379 wait complete. 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.132+0000 7f1e14eff6c0 1 Processor -- start 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.132+0000 7f1e14eff6c0 1 -- start start 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e14eff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 0x7f1e10154c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e14eff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1e101347c0 0x7f1e10175770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e14eff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e100ff780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e14eff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1e100ffe80 con 0x7f1e10113dc0 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e14eff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e100ffff0 con 0x7f1e101347c0 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e14eff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1e10100710 con 0x7f1e10155340 2026-02-13T01:23:25.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e0ed766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e100ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e0ed766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e100ff780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53406/0 (socket says 10.20.193.28:53406) 2026-02-13T01:23:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e0ed766c0 1 -- 10.20.193.28:0/3217008409 learned_addr learned my addr 10.20.193.28:0/3217008409 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e0e5756c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 0x7f1e10154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.133+0000 7f1e0dd746c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1e101347c0 0x7f1e10175770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0e5756c0 1 -- 10.20.193.28:0/3217008409 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 msgr2=0x7f1e100ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0e5756c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e100ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0e5756c0 1 -- 10.20.193.28:0/3217008409 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1e101347c0 msgr2=0x7f1e10175770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85dc03f8f0 msgr2=0x7f85dc05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85dc03f8f0 0x7f85dc05fda0 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85f0004750 tx=0x7f85f0009390 comp rx=0 tx=0).stop 2026-02-13T01:23:25.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0e5756c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1e101347c0 0x7f1e10175770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0e5756c0 1 -- 10.20.193.28:0/3217008409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000081c0 con 0x7f1e10113dc0 2026-02-13T01:23:25.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0ed766c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e100ff780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:25.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f1e0e5756c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 0x7f1e10154c00 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0400b6c0 tx=0x7f1e0400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 msgr2=0x7f86080f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.135+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 0x7f86080f4d70 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85fc00ac90 tx=0x7f85fc0042d0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.136+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 shutdown_connections 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.136+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85dc03f8f0 0x7f85dc05fda0 unknown :-1 s=CLOSED pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.136+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f860810bdc0 0x7f860816d100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.136+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f860810c770 0x7f86080f55d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.136+0000 7f8607fff6c0 1 --2- 10.20.193.28:0/2733861533 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f860810ac40 0x7f86080f4d70 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.136+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 >> 10.20.193.28:0/2733861533 conn(0x7f86080e8320 msgr2=0x7f8608059130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.137+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 shutdown_connections 2026-02-13T01:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.137+0000 7f8607fff6c0 1 -- 10.20.193.28:0/2733861533 wait complete. 2026-02-13T01:23:25.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.141+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e04004560 con 0x7f1e10113dc0 2026-02-13T01:23:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.141+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e04009030 con 0x7f1e10113dc0 2026-02-13T01:23:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.141+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e0400cd20 con 0x7f1e10113dc0 2026-02-13T01:23:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.141+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e101009f0 con 0x7f1e10113dc0 2026-02-13T01:23:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.141+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e10100e80 con 0x7f1e10113dc0 2026-02-13T01:23:25.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.144+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e10179720 con 0x7f1e10113dc0 2026-02-13T01:23:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2664732794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d041554e0 msgr2=0x7f4d04175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2664732794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d041554e0 0x7f4d04175990 secure :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=8015721813378174923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf8006fd0 tx=0x7f4cf8030eb0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2664732794 shutdown_connections 2026-02-13T01:23:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2664732794 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d04134920 0x7f4d04154da0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2664732794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d041554e0 0x7f4d04175990 unknown :-1 s=CLOSED pgs=6 gs=2 cs=0 l=1 c_cookie=8015721813378174923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2664732794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04113f70 0x7f4d04134350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2664732794 >> 10.20.193.28:0/2664732794 conn(0x7f4d0405b8e0 msgr2=0x7f4d0405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2664732794 shutdown_connections 2026-02-13T01:23:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.148+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2664732794 wait complete. 2026-02-13T01:23:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.149+0000 7f4d0a2986c0 1 Processor -- start 2026-02-13T01:23:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.149+0000 7f4d0a2986c0 1 -- start start 2026-02-13T01:23:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0a2986c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d04113f70 0x7f4d041758c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0a2986c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 0x7f4d0410d840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0a2986c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d041554e0 0x7f4d0410df90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0a2986c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0410eba0 con 0x7f4d04134920 2026-02-13T01:23:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0a2986c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0410ed10 con 0x7f4d04113f70 2026-02-13T01:23:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0a2986c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0410eed0 con 0x7f4d041554e0 2026-02-13T01:23:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d037fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 0x7f4d0410d840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f1e040026b0 con 0x7f1e10113dc0 2026-02-13T01:23:25.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d03fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d04113f70 0x7f4d041758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d037fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 0x7f4d0410d840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51114/0 (socket says 10.20.193.28:51114) 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d03fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d04113f70 0x7f4d041758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33368/0 (socket says 10.20.193.28:33368) 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d03fff6c0 1 -- 10.20.193.28:0/2281449185 learned_addr learned my addr 10.20.193.28:0/2281449185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.150+0000 7f4d0880a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d041554e0 0x7f4d0410df90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d0880a6c0 1 -- 10.20.193.28:0/2281449185 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d04113f70 msgr2=0x7f4d041758c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d0880a6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d04113f70 0x7f4d041758c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d0880a6c0 1 -- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 msgr2=0x7f4d0410d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d0880a6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 0x7f4d0410d840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d0880a6c0 1 -- 10.20.193.28:0/2281449185 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0009590 con 0x7f4d041554e0 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d037fe6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 0x7f4d0410d840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:25.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.151+0000 7f4d0880a6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d041554e0 0x7f4d0410df90 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf80313c0 tx=0x7f4cf80055e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.152+0000 7f1df77fe6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1de403f940 0x7f1de405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.152+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f1e04051090 con 0x7f1e10113dc0 2026-02-13T01:23:25.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.152+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fdf0c0c9f30 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.152+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1e04051440 con 0x7f1e10113dc0 2026-02-13T01:23:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.152+0000 7f1e0dd746c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1de403f940 0x7f1de405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.152+0000 7f1e0dd746c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1de403f940 0x7f1de405fdf0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1df8004750 tx=0x7f1df8005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.157+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cf8005b10 con 0x7f4d041554e0 2026-02-13T01:23:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.157+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4cf8003cf0 con 0x7f4d041554e0 2026-02-13T01:23:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.157+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cf800b070 con 0x7f4d041554e0 2026-02-13T01:23:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.157+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf80081c0 con 0x7f4d041554e0 2026-02-13T01:23:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.157+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0410f440 con 0x7f4d041554e0 2026-02-13T01:23:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.160+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0410f600 con 0x7f4d041554e0 2026-02-13T01:23:25.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.168+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4cf8005c70 con 0x7f4d041554e0 2026-02-13T01:23:25.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.168+0000 7f4d017fa6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4cd403f8c0 0x7f4cd405fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.168+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4cf8049680 con 0x7f4d041554e0 2026-02-13T01:23:25.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.168+0000 7fdf127fc6c0 1 -- 10.20.193.28:0/2839445035 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v20)=0 v20) ==== 127+0+0 (secure 0 0 0) 0x7fdf08033e20 con 0x7fdf0c0c3b50 2026-02-13T01:23:25.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdeec03f870 msgr2=0x7fdeec05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdeec03f870 0x7fdeec05fd20 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef8005980 tx=0x7fdef8005df0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 msgr2=0x7fdf0c0abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0abd20 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf08030a90 tx=0x7fdf080055a0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 shutdown_connections 2026-02-13T01:23:25.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdeec03f870 0x7fdeec05fd20 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdf0c0c4b10 0x7fdf0c0ac370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdf0c0c54c0 0x7fdf0c0acf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 --2- 10.20.193.28:0/2839445035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf0c0c3b50 0x7fdf0c0abd20 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 >> 10.20.193.28:0/2839445035 conn(0x7fdf0c0a1260 msgr2=0x7fdf0c0c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 shutdown_connections 2026-02-13T01:23:25.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.173+0000 7fdf1a5746c0 1 -- 10.20.193.28:0/2839445035 wait complete. 2026-02-13T01:23:25.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.176+0000 7f4d03fff6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4cd403f8c0 0x7f4cd405fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.176+0000 7f4d03fff6c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4cd403f8c0 0x7f4cd405fd70 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf0005b40 tx=0x7f4cf0009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.192+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4cf800b700 con 0x7f4d041554e0 2026-02-13T01:23:25.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.240+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/2658443345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc1137a0 msgr2=0x7f88dc113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.240+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/2658443345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc1137a0 0x7f88dc113b90 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=14578894558302464760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88d0009970 tx=0x7f88d002ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:25.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.240+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/2658443345 shutdown_connections 2026-02-13T01:23:25.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.240+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/2658443345 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc114cb0 0x7f88dc1757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.240+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/2658443345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114120 0x7f88dc114570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.241+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/2658443345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc1137a0 0x7f88dc113b90 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=14578894558302464760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.241+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/2658443345 >> 10.20.193.28:0/2658443345 conn(0x7f88dc064120 msgr2=0x7f88dc064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.241+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/2658443345 shutdown_connections 2026-02-13T01:23:25.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.241+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/2658443345 wait complete. 2026-02-13T01:23:25.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.242+0000 7f88dbfff6c0 1 Processor -- start 2026-02-13T01:23:25.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.242+0000 7f88dbfff6c0 1 -- start start 2026-02-13T01:23:25.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.243+0000 7f88dbfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 0x7f88dc118cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.243+0000 7f88dbfff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc114120 0x7f88dc119310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.243+0000 7f88dbfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114cb0 0x7f88dc119f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88dbfff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc11a690 con 0x7f88dc114cb0 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88dbfff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc11a800 con 0x7f88dc1137a0 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88dbfff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc11a9c0 con 0x7f88dc114120 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88da7fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc114120 0x7f88dc119310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88db7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114cb0 0x7f88dc119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88daffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 0x7f88dc118cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88daffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 0x7f88dc118cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33378/0 (socket says 10.20.193.28:33378) 2026-02-13T01:23:25.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.244+0000 7f88daffd6c0 1 -- 10.20.193.28:0/4180570034 learned_addr learned my addr 10.20.193.28:0/4180570034 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88db7fe6c0 1 -- 10.20.193.28:0/4180570034 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc114120 msgr2=0x7f88dc119310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88db7fe6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc114120 0x7f88dc119310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88db7fe6c0 1 -- 10.20.193.28:0/4180570034 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 msgr2=0x7f88dc118cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88db7fe6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 0x7f88dc118cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88db7fe6c0 1 -- 10.20.193.28:0/4180570034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c40094c0 con 0x7f88dc114cb0 2026-02-13T01:23:25.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88daffd6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 0x7f88dc118cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:25.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.245+0000 7f88da7fc6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc114120 0x7f88dc119310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:25.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.246+0000 7f88db7fe6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114cb0 0x7f88dc119f00 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88cc00c6c0 tx=0x7f88cc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.247+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88cc005340 con 0x7f88dc114cb0 2026-02-13T01:23:25.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.247+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f88cc003cf0 con 0x7f88dc114cb0 2026-02-13T01:23:25.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.247+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88cc00dd30 con 0x7f88dc114cb0 2026-02-13T01:23:25.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.247+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d0009590 con 0x7f88dc114cb0 2026-02-13T01:23:25.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.248+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc15b140 con 0x7f88dc114cb0 2026-02-13T01:23:25.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.250+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f88cc003810 con 0x7f88dc114cb0 2026-02-13T01:23:25.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.250+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88dc11ad30 con 0x7f88dc114cb0 2026-02-13T01:23:25.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.250+0000 7f88e08ea6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88b003f8f0 0x7f88b005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.250+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f88cc0521a0 con 0x7f88dc114cb0 2026-02-13T01:23:25.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.254+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88cc005bf0 con 0x7f88dc114cb0 2026-02-13T01:23:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.266+0000 7f88daffd6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88b003f8f0 0x7f88b005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.266+0000 7f88daffd6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88b003f8f0 0x7f88b005fda0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88d002fb00 tx=0x7f88d0005b00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.288+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f1e10178dc0 con 0x7f1e10113dc0 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.005+0000 7fd1d8a77fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.014+0000 7fd1d8a77fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.020+0000 7fd1d8a77fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.027+0000 7fd1d8a77fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.033+0000 7fd1d8a77fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.045+0000 7fd1d8a77fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.069+0000 7fd1d8a77fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.073+0000 7fd1d8a77fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:23:25.302 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.074+0000 7fd1d8a77fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.081+0000 7fd1d8a77fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.118+0000 7fd1d8a77fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.120+0000 7fd1d8a77fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.124+0000 7fd1d8a77fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.126+0000 7fd1d8a77fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.126+0000 7fd1d8a77fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.129+0000 7fd1d8a77fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.130+0000 7fd1d8a77fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.133+0000 7fd1d8a77fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.135+0000 7fd1d8a77fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.304+0000 7fd1d8a77fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:23:25.303 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.304+0000 7fd1d8a77fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:23:25.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.292+0000 7f1df77fe6c0 1 -- 10.20.193.28:0/3217008409 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f1e04004780 con 0x7f1e10113dc0 2026-02-13T01:23:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1de403f940 msgr2=0x7f1de405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1de403f940 0x7f1de405fdf0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1df8004750 tx=0x7f1df8005e60 comp rx=0 tx=0).stop 2026-02-13T01:23:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 msgr2=0x7f1e10154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 0x7f1e10154c00 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0400b6c0 tx=0x7f1e0400bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 shutdown_connections 2026-02-13T01:23:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1de403f940 0x7f1de405fdf0 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1e10155340 0x7f1e100ff780 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1e101347c0 0x7f1e10175770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 --2- 10.20.193.28:0/3217008409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e10113dc0 0x7f1e10154c00 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.311+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 >> 10.20.193.28:0/3217008409 conn(0x7f1e1005b720 msgr2=0x7f1e100f6000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.312+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 shutdown_connections 2026-02-13T01:23:25.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.312+0000 7f1e14eff6c0 1 -- 10.20.193.28:0/3217008409 wait complete. 2026-02-13T01:23:25.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.353+0000 7f570307b6c0 1 -- 10.20.193.28:0/978167168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc113dc0 msgr2=0x7f56fc1341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.353+0000 7f570307b6c0 1 --2- 10.20.193.28:0/978167168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc113dc0 0x7f56fc1341a0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=3389343127283014968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f800aa40 tx=0x7f56f802fe30 comp rx=0 tx=0).stop 2026-02-13T01:23:25.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.359+0000 7f570307b6c0 1 -- 10.20.193.28:0/978167168 shutdown_connections 2026-02-13T01:23:25.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.359+0000 7f570307b6c0 1 --2- 10.20.193.28:0/978167168 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f56fc155340 0x7f56fc1757f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.359+0000 7f570307b6c0 1 --2- 10.20.193.28:0/978167168 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f56fc1347c0 0x7f56fc154c00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.359+0000 7f570307b6c0 1 --2- 10.20.193.28:0/978167168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc113dc0 0x7f56fc1341a0 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=3389343127283014968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.359+0000 7f570307b6c0 1 -- 10.20.193.28:0/978167168 >> 10.20.193.28:0/978167168 conn(0x7f56fc05b720 msgr2=0x7f56fc05bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.381+0000 7fcb9d04b6c0 1 -- 10.20.193.28:0/1994655629 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb8c0044a0 con 0x7fcb981109f0 2026-02-13T01:23:25.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.381+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1994655629 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 msgr2=0x7fcb98171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.381+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1994655629 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98171380 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=11794986668803812972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb8c0098a0 tx=0x7fcb8c02ec40 comp rx=0 tx=0).stop 2026-02-13T01:23:25.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1994655629 shutdown_connections 2026-02-13T01:23:25.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1994655629 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 0x7fcb981104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1994655629 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98171380 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=11794986668803812972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1994655629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 0x7fcb9810f2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1994655629 >> 10.20.193.28:0/1994655629 conn(0x7fcb980ec5c0 msgr2=0x7fcb9810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1994655629 shutdown_connections 2026-02-13T01:23:25.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.382+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1994655629 wait complete. 2026-02-13T01:23:25.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.383+0000 7fcba02d86c0 1 Processor -- start 2026-02-13T01:23:25.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.384+0000 7fcba02d86c0 1 -- start start 2026-02-13T01:23:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcba02d86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 0x7fcb981019a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcba02d86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 0x7fcb98171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcba02d86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98102200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcba02d86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98102e30 con 0x7fcb9810eec0 2026-02-13T01:23:25.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcba02d86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98102fa0 con 0x7fcb981109f0 2026-02-13T01:23:25.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcba02d86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98103160 con 0x7fcb98110040 2026-02-13T01:23:25.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcb9e84e6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98102200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcb9e84e6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98102200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33408/0 (socket says 10.20.193.28:33408) 2026-02-13T01:23:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.385+0000 7fcb9e84e6c0 1 -- 10.20.193.28:0/1271785797 learned_addr learned my addr 10.20.193.28:0/1271785797 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.386+0000 7fcb9e84e6c0 1 -- 10.20.193.28:0/1271785797 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 msgr2=0x7fcb98171380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.387+0000 7fcb9d84c6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 0x7fcb98171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.387+0000 7fcb9e84e6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 0x7fcb98171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.387+0000 7fcb9e84e6c0 1 -- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 msgr2=0x7fcb981019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.388+0000 7fcb9e04d6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 0x7fcb981019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.388+0000 7fcb9e84e6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 0x7fcb981019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.388+0000 7fcb9e84e6c0 1 -- 10.20.193.28:0/1271785797 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9400a5b0 con 0x7fcb981109f0 2026-02-13T01:23:25.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.388+0000 7fcb9d84c6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 0x7fcb98171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.388+0000 7fcb9e04d6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 0x7fcb981019a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.388+0000 7fcb9e84e6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98102200 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb8c0097f0 tx=0x7fcb8c031d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.389+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb8c002750 con 0x7fcb981109f0 2026-02-13T01:23:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.389+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb8c002d90 con 0x7fcb981109f0 2026-02-13T01:23:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.389+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb8c007440 con 0x7fcb981109f0 2026-02-13T01:23:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.389+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb88009590 con 0x7fcb981109f0 2026-02-13T01:23:25.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.390+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c0094c0 con 0x7fcb981109f0 2026-02-13T01:23:25.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.392+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb981753f0 con 0x7fcb981109f0 2026-02-13T01:23:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.392+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fcb8c0075d0 con 0x7fcb981109f0 2026-02-13T01:23:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.392+0000 7fcb877fe6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb7403f940 0x7fcb7405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.393+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fcb8c075470 con 0x7fcb981109f0 2026-02-13T01:23:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.393+0000 7fcb9e04d6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb7403f940 0x7fcb7405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.394+0000 7fcb9e04d6c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb7403f940 0x7fcb7405fdf0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb94005830 tx=0x7fcb9400a310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.394+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb8c032270 con 0x7fcb981109f0 2026-02-13T01:23:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.395+0000 7f49fb9936c0 1 -- 10.20.193.28:0/2450384707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c3df0 msgr2=0x7f49ec0c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.400+0000 7f49e3fff6c0 1 -- 10.20.193.28:0/2450384707 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49f4058ad0 con 0x7f49ec0c3df0 2026-02-13T01:23:25.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.400+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/2450384707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c3df0 0x7f49ec0c41e0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=14814432807437025372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49f4054080 tx=0x7f49f407e590 comp rx=0 tx=0).stop 2026-02-13T01:23:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f88dc1790e0 con 0x7f88dc114cb0 2026-02-13T01:23:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 -- 10.20.193.28:0/2450384707 shutdown_connections 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/2450384707 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f49ec0c4f70 0x7f49ec0c53e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/2450384707 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49ec0c5920 0x7f49ec1262b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/2450384707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c3df0 0x7f49ec0c41e0 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=14814432807437025372 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 -- 10.20.193.28:0/2450384707 >> 10.20.193.28:0/2450384707 conn(0x7f49ec0a10b0 msgr2=0x7f49ec0c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 -- 10.20.193.28:0/2450384707 shutdown_connections 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.409+0000 7f49fb9936c0 1 -- 10.20.193.28:0/2450384707 wait complete. 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 Processor -- start 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 -- start start 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49ec0c3df0 0x7f49ec135e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 0x7f49ec136350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f49ec0c5920 0x7f49ec1262b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec136b40 con 0x7f49ec0c4f70 2026-02-13T01:23:25.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec136cb0 con 0x7f49ec0c3df0 2026-02-13T01:23:25.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49fb9936c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec1cf890 con 0x7f49ec0c5920 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 0x7f49ec136350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 0x7f49ec136350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51194/0 (socket says 10.20.193.28:51194) 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 -- 10.20.193.28:0/1552326923 learned_addr learned my addr 10.20.193.28:0/1552326923 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 -- 10.20.193.28:0/1552326923 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f49ec0c5920 msgr2=0x7f49ec1262b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f49ec0c5920 0x7f49ec1262b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 -- 10.20.193.28:0/1552326923 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49ec0c3df0 msgr2=0x7f49ec135e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:25.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49ec0c3df0 0x7f49ec135e10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 -- 10.20.193.28:0/1552326923 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f404beb0 con 0x7f49ec0c4f70 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f49f8f036c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 0x7f49ec136350 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e800b710 tx=0x7f49e800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.417+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49e8004250 con 0x7f49ec0c4f70 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.417+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ec1cfb70 con 0x7f49ec0c4f70 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.417+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ec1d00a0 con 0x7f49ec0c4f70 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.417+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f49e8009070 con 0x7f49ec0c4f70 2026-02-13T01:23:25.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.417+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49e8004250 con 0x7f49ec0c4f70 2026-02-13T01:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.411+0000 7f88e08ea6c0 1 -- 10.20.193.28:0/4180570034 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f88cc0098c0 con 0x7f88dc114cb0 2026-02-13T01:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88b003f8f0 msgr2=0x7f88b005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88b003f8f0 0x7f88b005fda0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88d002fb00 tx=0x7f88d0005b00 comp rx=0 tx=0).stop 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114cb0 msgr2=0x7f88dc119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114cb0 0x7f88dc119f00 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88cc00c6c0 tx=0x7f88cc00cb90 comp rx=0 tx=0).stop 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 shutdown_connections 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88b003f8f0 0x7f88b005fda0 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88dc114120 0x7f88dc119310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88dc114cb0 0x7f88dc119f00 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 --2- 10.20.193.28:0/4180570034 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88dc1137a0 0x7f88dc118cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 >> 10.20.193.28:0/4180570034 conn(0x7f88dc064120 msgr2=0x7f88dc0586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 shutdown_connections 2026-02-13T01:23:25.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f88dbfff6c0 1 -- 10.20.193.28:0/4180570034 wait complete. 2026-02-13T01:23:25.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f49e800cb60 con 0x7f49ec0c4f70 2026-02-13T01:23:25.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f49e27fc6c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f49d003f950 0x7f49d005fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ec129fa0 con 0x7f49ec0c4f70 2026-02-13T01:23:25.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f49e8052130 con 0x7f49ec0c4f70 2026-02-13T01:23:25.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f570307b6c0 1 -- 10.20.193.28:0/978167168 shutdown_connections 2026-02-13T01:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.419+0000 7f570307b6c0 1 -- 10.20.193.28:0/978167168 wait complete. 2026-02-13T01:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 Processor -- start 2026-02-13T01:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 -- start start 2026-02-13T01:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f56fc113dc0 0x7f56fc1341a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f56fc1347c0 0x7f56fc1757d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 0x7f56fc0ffb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc1002c0 con 0x7f56fc155340 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc100430 con 0x7f56fc1347c0 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570307b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc100a70 con 0x7f56fc113dc0 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 0x7f56fc0ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 0x7f56fc0ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51198/0 (socket says 10.20.193.28:51198) 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 -- 10.20.193.28:0/2918895400 learned_addr learned my addr 10.20.193.28:0/2918895400 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 -- 10.20.193.28:0/2918895400 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f56fc113dc0 msgr2=0x7f56fc1341a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f56fc113dc0 0x7f56fc1341a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 -- 10.20.193.28:0/2918895400 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f56fc1347c0 msgr2=0x7f56fc1757d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f56fc1347c0 0x7f56fc1757d0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.425+0000 7f570287a6c0 1 -- 10.20.193.28:0/2918895400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f800a660 con 0x7f56fc155340 2026-02-13T01:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f570287a6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 0x7f56fc0ffb30 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f0009fd0 tx=0x7f56f000b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f49fa7066c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f49d003f950 0x7f49d005fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f00044a0 con 0x7f56fc155340 2026-02-13T01:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56f0004600 con 0x7f56fc155340 2026-02-13T01:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56fc100d50 con 0x7f56fc155340 2026-02-13T01:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56fc101230 con 0x7f56fc155340 2026-02-13T01:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56fc1798b0 con 0x7f56fc155340 2026-02-13T01:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49e8011060 con 0x7f49ec0c4f70 2026-02-13T01:23:25.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f49fa7066c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f49d003f950 0x7f49d005fe00 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49f4052b90 tx=0x7f49f4054450 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f00044a0 con 0x7f56fc155340 2026-02-13T01:23:25.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f56f000c940 con 0x7f56fc155340 2026-02-13T01:23:25.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f56d403f900 0x7f56d405fdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f56f00039b0 con 0x7f56fc155340 2026-02-13T01:23:25.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.427+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f56f0007230 con 0x7f56fc155340 2026-02-13T01:23:25.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.435+0000 7f57020796c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f56d403f900 0x7f56d405fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.436+0000 7f57020796c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f56d403f900 0x7f56d405fdb0 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f800a990 tx=0x7f56f8002470 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.472 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.473 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 -- 10.20.193.28:0/1710600634 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 msgr2=0x7fd7d4176680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/1710600634 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d4176680 secure :-1 s=READY pgs=9 gs=3 cs=0 l=1 c_cookie=14401928065461797490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7bc0098a0 tx=0x7fd7bc02ec60 comp rx=0 tx=0).stop 2026-02-13T01:23:25.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 -- 10.20.193.28:0/1710600634 shutdown_connections 2026-02-13T01:23:25.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/1710600634 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 0x7fd7d4155d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/1710600634 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d4176680 unknown :-1 s=CLOSED pgs=9 gs=3 cs=0 l=1 c_cookie=14401928065461797490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/1710600634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4113f70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 -- 10.20.193.28:0/1710600634 >> 10.20.193.28:0/1710600634 conn(0x7fd7d405b8e0 msgr2=0x7fd7d405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 -- 10.20.193.28:0/1710600634 shutdown_connections 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.481+0000 7fd7dae146c0 1 -- 10.20.193.28:0/1710600634 wait complete. 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.483+0000 7fd7dae146c0 1 Processor -- start 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.483+0000 7fd7dae146c0 1 -- start start 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.483+0000 7fd7dae146c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4155d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7d8b896c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7d8b896c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51212/0 (socket says 10.20.193.28:51212) 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7d8b896c0 1 -- 10.20.193.28:0/4056466844 learned_addr learned my addr 10.20.193.28:0/4056466844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 0x7fd7d4176680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d40ff960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d41000f0 con 0x7fd7d405d830 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4100260 con 0x7fd7d41562a0 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4100880 con 0x7fd7d4135980 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7d3fff6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 0x7fd7d4176680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.484+0000 7fd7d938a6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d40ff960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d8b896c0 1 -- 10.20.193.28:0/4056466844 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 msgr2=0x7fd7d4176680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d8b896c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 0x7fd7d4176680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d8b896c0 1 -- 10.20.193.28:0/4056466844 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 msgr2=0x7fd7d40ff960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d8b896c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d40ff960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d8b896c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc0094c0 con 0x7fd7d405d830 2026-02-13T01:23:25.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d938a6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d40ff960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d3fff6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 0x7fd7d4176680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d8b896c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4155d60 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7c400a3c0 tx=0x7fd7c400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7c4003c40 con 0x7fd7d405d830 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd7c400a070 con 0x7fd7d405d830 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7c40081c0 con 0x7fd7d405d830 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d4100b60 con 0x7fd7d405d830 2026-02-13T01:23:25.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.485+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d4100ff0 con 0x7fd7d405d830 2026-02-13T01:23:25.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.488+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fd7c400d5b0 con 0x7fd7d405d830 2026-02-13T01:23:25.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.489+0000 7fd7d1ffb6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd7a403f940 0x7fd7a405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.489+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d41798b0 con 0x7fd7d405d830 2026-02-13T01:23:25.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.492+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fd7c4052370 con 0x7fd7d405d830 2026-02-13T01:23:25.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.492+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7c4054890 con 0x7fd7d405d830 2026-02-13T01:23:25.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.493+0000 7fd7d3fff6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd7a403f940 0x7fd7a405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.494+0000 7fd7d3fff6c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd7a403f940 0x7fd7a405fdf0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7c8005980 tx=0x7fd7c8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.525+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fcb98174d80 con 0x7fcb981109f0 2026-02-13T01:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.530+0000 7fcb877fe6c0 1 -- 10.20.193.28:0/1271785797 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7fcb8c0368d0 con 0x7fcb981109f0 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb7403f940 msgr2=0x7fcb7405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb7403f940 0x7fcb7405fdf0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb94005830 tx=0x7fcb9400a310 comp rx=0 tx=0).stop 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 msgr2=0x7fcb98102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98102200 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb8c0097f0 tx=0x7fcb8c031d90 comp rx=0 tx=0).stop 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 shutdown_connections 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb7403f940 0x7fcb7405fdf0 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb98110040 0x7fcb98171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb981109f0 0x7fcb98102200 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 --2- 10.20.193.28:0/1271785797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb9810eec0 0x7fcb981019a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.535+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 >> 10.20.193.28:0/1271785797 conn(0x7fcb980ec5c0 msgr2=0x7fcb980561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.536+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 shutdown_connections 2026-02-13T01:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.536+0000 7fcba02d86c0 1 -- 10.20.193.28:0/1271785797 wait complete. 2026-02-13T01:23:25.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.563+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f56c80051d0 con 0x7f56fc155340 2026-02-13T01:23:25.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.567+0000 7f56eb7fe6c0 1 -- 10.20.193.28:0/2918895400 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v24)=0 v24) ==== 116+0+0 (secure 0 0 0) 0x7f56f0007230 con 0x7f56fc155340 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.572+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/319776771 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80007040 msgr2=0x7f3f800074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.572+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/319776771 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80007040 0x7f3f800074b0 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=10583901099589714132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f78009d00 tx=0x7f3f7802f0a0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/319776771 shutdown_connections 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/319776771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f800079f0 0x7f3f80008350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/319776771 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80007040 0x7f3f800074b0 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=10583901099589714132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/319776771 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3f80005ec0 0x7f3f800062b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/319776771 >> 10.20.193.28:0/319776771 conn(0x7f3f800a0f30 msgr2=0x7f3f800c1360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/319776771 shutdown_connections 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.583+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/319776771 wait complete. 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.585+0000 7f3f8eb8e6c0 1 Processor -- start 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 -- start start 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80005ec0 0x7f3f8016fba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 0x7f3f801701f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3f800079f0 0x7f3f80170de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80171570 con 0x7f3f80007040 2026-02-13T01:23:25.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801716e0 con 0x7f3f80005ec0 2026-02-13T01:23:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8eb8e6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801718a0 con 0x7f3f800079f0 2026-02-13T01:23:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.588+0000 7f3f8db8c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 0x7f3f801701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.589+0000 7f3f8db8c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 0x7f3f801701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51224/0 (socket says 10.20.193.28:51224) 2026-02-13T01:23:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.589+0000 7f3f8db8c6c0 1 -- 10.20.193.28:0/2800137754 learned_addr learned my addr 10.20.193.28:0/2800137754 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.589+0000 7f3f9061c6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80005ec0 0x7f3f8016fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.589+0000 7f3f8e38d6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3f800079f0 0x7f3f80170de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.589+0000 7f3f8db8c6c0 1 -- 10.20.193.28:0/2800137754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3f800079f0 msgr2=0x7f3f80170de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.589+0000 7f3f8db8c6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3f800079f0 0x7f3f80170de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.590+0000 7f3f8db8c6c0 1 -- 10.20.193.28:0/2800137754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80005ec0 msgr2=0x7f3f8016fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.590+0000 7f3f8db8c6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80005ec0 0x7f3f8016fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.590+0000 7f3f8db8c6c0 1 -- 10.20.193.28:0/2800137754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8804bf70 con 0x7f3f80007040 2026-02-13T01:23:25.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.590+0000 7f3f8db8c6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 0x7f3f801701f0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f780023c0 tx=0x7f3f780044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.577+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f56d403f900 msgr2=0x7f56d405fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.577+0000 7f570307b6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f56d403f900 0x7f56d405fdb0 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f800a990 tx=0x7f56f8002470 comp rx=0 tx=0).stop 2026-02-13T01:23:25.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.577+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 msgr2=0x7f56fc0ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.577+0000 7f570307b6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 0x7f56fc0ffb30 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f0009fd0 tx=0x7f56f000b930 comp rx=0 tx=0).stop 2026-02-13T01:23:25.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 shutdown_connections 2026-02-13T01:23:25.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56fc155340 0x7f56fc0ffb30 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f56fc1347c0 0x7f56fc1757d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f56d403f900 0x7f56d405fdb0 unknown :-1 s=CLOSED pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 --2- 10.20.193.28:0/2918895400 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f56fc113dc0 0x7f56fc1341a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 >> 10.20.193.28:0/2918895400 conn(0x7f56fc05b720 msgr2=0x7f56fc0f6330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 shutdown_connections 2026-02-13T01:23:25.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f570307b6c0 1 -- 10.20.193.28:0/2918895400 wait complete. 2026-02-13T01:23:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.600+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f78002ae0 con 0x7f3f80007040 2026-02-13T01:23:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.603+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f7802fde0 con 0x7f3f80007040 2026-02-13T01:23:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.605+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f78036360 con 0x7f3f80007040 2026-02-13T01:23:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 -- 10.20.193.28:0/20445288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010ddd0 msgr2=0x7f615010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/20445288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010ddd0 0x7f615010e240 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=3408117609192001669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61440098a0 tx=0x7f614402ec40 comp rx=0 tx=0).stop 2026-02-13T01:23:25.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 -- 10.20.193.28:0/20445288 shutdown_connections 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/20445288 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010e780 0x7f615016f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/20445288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010ddd0 0x7f615010e240 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=3408117609192001669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/20445288 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010cc50 0x7f615010d040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 -- 10.20.193.28:0/20445288 >> 10.20.193.28:0/20445288 conn(0x7f61500ea370 msgr2=0x7f615010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 -- 10.20.193.28:0/20445288 shutdown_connections 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f61576ff6c0 1 -- 10.20.193.28:0/20445288 wait complete. 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.602+0000 7f61576ff6c0 1 Processor -- start 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.603+0000 7f61576ff6c0 1 -- start start 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.603+0000 7f61576ff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010cc50 0x7f61500f85d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.603+0000 7f61576ff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 0x7f615016f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.603+0000 7f61576ff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 0x7f61500f8e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f61576ff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f61500f9a60 con 0x7f615010e780 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6154c6f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 0x7f615016f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6155c716c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 0x7f61500f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6154c6f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 0x7f615016f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53538/0 (socket says 10.20.193.28:53538) 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f61576ff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61500f9bd0 con 0x7f615010cc50 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f61576ff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f61500f9d90 con 0x7f615010ddd0 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6155c716c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 0x7f61500f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51260/0 (socket says 10.20.193.28:51260) 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6155c716c0 1 -- 10.20.193.28:0/3888987754 learned_addr learned my addr 10.20.193.28:0/3888987754 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6155c716c0 1 -- 10.20.193.28:0/3888987754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 msgr2=0x7f615016f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6155c716c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 0x7f615016f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6155c716c0 1 -- 10.20.193.28:0/3888987754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010cc50 msgr2=0x7f61500f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f6154c6f6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 0x7f615016f0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:25.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.603+0000 7f61554706c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010cc50 0x7f61500f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f6155c716c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010cc50 0x7f61500f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f6155c716c0 1 -- 10.20.193.28:0/3888987754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61440094c0 con 0x7f615010e780 2026-02-13T01:23:25.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f91e65686c0 1 -- 10.20.193.28:0/4017935241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010ae10 msgr2=0x7f91e010b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.601+0000 7f91e65686c0 1 --2- 10.20.193.28:0/4017935241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010ae10 0x7f91e010b200 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=10166687380898375285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91cc009bd0 tx=0x7f91cc02ef70 comp rx=0 tx=0).stop 2026-02-13T01:23:25.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f91e65686c0 1 -- 10.20.193.28:0/4017935241 shutdown_connections 2026-02-13T01:23:25.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f91e65686c0 1 --2- 10.20.193.28:0/4017935241 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 0x7f91e010c400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f91e65686c0 1 --2- 10.20.193.28:0/4017935241 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010c940 0x7f91e016d2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f91e65686c0 1 --2- 10.20.193.28:0/4017935241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010ae10 0x7f91e010b200 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=10166687380898375285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.604+0000 7f91e65686c0 1 -- 10.20.193.28:0/4017935241 >> 10.20.193.28:0/4017935241 conn(0x7f91e00e8510 msgr2=0x7f91e0108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.605+0000 7f91e65686c0 1 -- 10.20.193.28:0/4017935241 shutdown_connections 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.605+0000 7f91e65686c0 1 -- 10.20.193.28:0/4017935241 wait complete. 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f91e65686c0 1 Processor -- start 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f91e65686c0 1 -- start start 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f91e65686c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010ae10 0x7f91e017d000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f91e65686c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 0x7f91e017d5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f91e65686c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010c940 0x7f91e016d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f91e65686c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91e0216580 con 0x7f91e010c940 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f91e65686c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f91e02166f0 con 0x7f91e010ae10 2026-02-13T01:23:25.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f91e65686c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f91e02168b0 con 0x7f91e010bf90 2026-02-13T01:23:25.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91df7fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 0x7f91e017d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91df7fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 0x7f91e017d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53566/0 (socket says 10.20.193.28:53566) 2026-02-13T01:23:25.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91df7fe6c0 1 -- 10.20.193.28:0/981528443 learned_addr learned my addr 10.20.193.28:0/981528443 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91e4ada6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010c940 0x7f91e016d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f780094c0 con 0x7f3f80007040 2026-02-13T01:23:25.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.606+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801d1e80 con 0x7f3f80007040 2026-02-13T01:23:25.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91dffff6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010ae10 0x7f91e017d000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91e4ada6c0 1 -- 10.20.193.28:0/981528443 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 msgr2=0x7f91e017d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f61554706c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010cc50 0x7f61500f85d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.609+0000 7f6155c716c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 0x7f61500f8e10 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f614c006ea0 tx=0x7f614c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.609+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f614c003810 con 0x7f615010e780 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.609+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f614c003e50 con 0x7f615010e780 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.609+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f614c00dde0 con 0x7f615010e780 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.609+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61500fa010 con 0x7f615010e780 2026-02-13T01:23:25.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.610+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f614c0082a0 con 0x7f615010e780 2026-02-13T01:23:25.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.610+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61500fa4a0 con 0x7f615010e780 2026-02-13T01:23:25.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f613e7fc6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f612c03f8f0 0x7f612c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f61554706c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f612c03f8f0 0x7f612c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.612+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8000c4d0 con 0x7f3f80007040 2026-02-13T01:23:25.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.612+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f614c023990 con 0x7f615010e780 2026-02-13T01:23:25.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.612+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3f7802f900 con 0x7f3f80007040 2026-02-13T01:23:25.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.613+0000 7f3f777fe6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3f5c03f940 0x7f3f5c05fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.613+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3f78075500 con 0x7f3f80007040 2026-02-13T01:23:25.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.616+0000 7f3f9061c6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3f5c03f940 0x7f3f5c05fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91e4ada6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 0x7f91e017d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.608+0000 7f91e4ada6c0 1 -- 10.20.193.28:0/981528443 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010ae10 msgr2=0x7f91e017d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.617+0000 7f91e4ada6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010ae10 0x7f91e017d000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.617+0000 7f91e4ada6c0 1 -- 10.20.193.28:0/981528443 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc009590 con 0x7f91e010c940 2026-02-13T01:23:25.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.617+0000 7f91dffff6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010ae10 0x7f91e017d000 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.617+0000 7f91e4ada6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010c940 0x7f91e016d2d0 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d4006fd0 tx=0x7f91d400cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.615+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6124005310 con 0x7f615010e780 2026-02-13T01:23:25.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.616+0000 7f61554706c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f612c03f8f0 0x7f612c05fda0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6140004750 tx=0x7f6140009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.617+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d4003a30 con 0x7f91e010c940 2026-02-13T01:23:25.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.618+0000 7f3f9061c6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3f5c03f940 0x7f3f5c05fdf0 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f84005b40 tx=0x7f3f84009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.618+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f614c004030 con 0x7f615010e780 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/3774375421 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f810c590 msgr2=0x7f88f810ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.607+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/3774375421 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f810c590 0x7f88f810ca30 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=1936270717263684270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e800aa40 tx=0x7f88e802fe30 comp rx=0 tx=0).stop 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/3774375421 shutdown_connections 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/3774375421 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f810c590 0x7f88f810ca30 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=1936270717263684270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/3774375421 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f8060d80 0x7f88f80611f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/3774375421 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f80621c0 0x7f88f8060840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.611+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/3774375421 >> 10.20.193.28:0/3774375421 conn(0x7f88f80ea190 msgr2=0x7f88f810a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.620+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e0216b90 con 0x7f91e010c940 2026-02-13T01:23:25.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.620+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e02170c0 con 0x7f91e010c940 2026-02-13T01:23:25.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.620+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91d400a070 con 0x7f91e010c940 2026-02-13T01:23:25.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.620+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d400de00 con 0x7f91e010c940 2026-02-13T01:23:25.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.620+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3f7802fbe0 con 0x7f3f80007040 2026-02-13T01:23:25.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f91d40081c0 con 0x7f91e010c940 2026-02-13T01:23:25.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f91dd7fa6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f91b003f8f0 0x7f91b005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f91d40529a0 con 0x7f91e010c940 2026-02-13T01:23:25.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f91dffff6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f91b003f8f0 0x7f91b005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.622+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/3774375421 shutdown_connections 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.623+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/3774375421 wait complete. 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.624+0000 7f88f7fff6c0 1 Processor -- start 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.624+0000 7f88f7fff6c0 1 -- start start 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.624+0000 7f88f7fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 0x7f88f811c740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.624+0000 7f88f7fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f80621c0 0x7f88f811cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f7fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f810c590 0x7f88f811d980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f7fff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f88f811e080 con 0x7f88f80621c0 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f7fff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88f811e1f0 con 0x7f88f810c590 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f7fff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f88f811e3b0 con 0x7f88f8060d80 2026-02-13T01:23:25.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f6ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 0x7f88f811c740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f6ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 0x7f88f811c740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53570/0 (socket says 10.20.193.28:53570) 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f6ffd6c0 1 -- 10.20.193.28:0/1676072175 learned_addr learned my addr 10.20.193.28:0/1676072175 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f67fc6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f80621c0 0x7f88f811cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.625+0000 7f88f77fe6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f810c590 0x7f88f811d980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f6ffd6c0 1 -- 10.20.193.28:0/1676072175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f810c590 msgr2=0x7f88f811d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f6ffd6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f810c590 0x7f88f811d980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f6ffd6c0 1 -- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f80621c0 msgr2=0x7f88f811cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f6ffd6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f80621c0 0x7f88f811cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f6ffd6c0 1 -- 10.20.193.28:0/1676072175 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e800a660 con 0x7f88f8060d80 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f77fe6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f810c590 0x7f88f811d980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:25.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.626+0000 7f88f67fc6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f80621c0 0x7f88f811cd90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:25.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.627+0000 7f88f6ffd6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 0x7f88f811c740 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e000b6c0 tx=0x7f88e000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.628+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88e00044a0 con 0x7f88f8060d80 2026-02-13T01:23:25.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.628+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f811e690 con 0x7f88f8060d80 2026-02-13T01:23:25.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.628+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f815ec70 con 0x7f88f8060d80 2026-02-13T01:23:25.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.628+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f88e0009030 con 0x7f88f8060d80 2026-02-13T01:23:25.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.628+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88e00044a0 con 0x7f88f8060d80 2026-02-13T01:23:25.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.630+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f88e000cbb0 con 0x7f88f8060d80 2026-02-13T01:23:25.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.628+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e0171120 con 0x7f91e010c940 2026-02-13T01:23:25.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.631+0000 7f88d7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88cc03f950 0x7f88cc05fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.631+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f88e0050d60 con 0x7f88f8060d80 2026-02-13T01:23:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.631+0000 7f91dffff6c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f91b003f8f0 0x7f91b005fda0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91cc009b20 tx=0x7f91cc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.631+0000 7f88f67fc6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88cc03f950 0x7f88cc05fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.632+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f91d40153f0 con 0x7f91e010c940 2026-02-13T01:23:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.632+0000 7f88f67fc6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88cc03f950 0x7f88cc05fe00 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ec004750 tx=0x7f88ec009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.638+0000 7fef9ba716c0 1 -- 10.20.193.28:0/1367847024 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef9405f330 msgr2=0x7fef9405f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.638+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/1367847024 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef9405f330 0x7fef9405f7a0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=2167547833721620249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef84009970 tx=0x7fef8402ed70 comp rx=0 tx=0).stop 2026-02-13T01:23:25.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 -- 10.20.193.28:0/1367847024 shutdown_connections 2026-02-13T01:23:25.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/1367847024 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef9405f330 0x7fef9405f7a0 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=2167547833721620249 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/1367847024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef94060640 0x7fef94060ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/1367847024 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fef9405e1b0 0x7fef9405e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 -- 10.20.193.28:0/1367847024 >> 10.20.193.28:0/1367847024 conn(0x7fef9405b8e0 msgr2=0x7fef9405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 -- 10.20.193.28:0/1367847024 shutdown_connections 2026-02-13T01:23:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.639+0000 7fef9ba716c0 1 -- 10.20.193.28:0/1367847024 wait complete. 2026-02-13T01:23:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.640+0000 7fef9ba716c0 1 Processor -- start 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 -- start start 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fef9405e1b0 0x7fef941368a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef9405f330 0x7fef94136ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 0x7fef94137aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef94138230 con 0x7fef9405f330 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef941383a0 con 0x7fef9405e1b0 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef9ba716c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fef94138560 con 0x7fef94060640 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef99fe36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 0x7fef94137aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef99fe36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 0x7fef94137aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:53606/0 (socket says 10.20.193.28:53606) 2026-02-13T01:23:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.641+0000 7fef99fe36c0 1 -- 10.20.193.28:0/3135687259 learned_addr learned my addr 10.20.193.28:0/3135687259 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.642+0000 7fef99fe36c0 1 -- 10.20.193.28:0/3135687259 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fef9405e1b0 msgr2=0x7fef941368a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.642+0000 7fef99fe36c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fef9405e1b0 0x7fef941368a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.642+0000 7fef99fe36c0 1 -- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef9405f330 msgr2=0x7fef94136ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.642+0000 7fef99fe36c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef9405f330 0x7fef94136ef0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.642+0000 7fef99fe36c0 1 -- 10.20.193.28:0/3135687259 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c00a5b0 con 0x7fef94060640 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.306+0000 7fd1d8a77fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.308+0000 7fd1d8a77fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.310+0000 7fd1d8a77fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.310+0000 7fd1d8a77fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.310+0000 7fd1d8a77fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.452+0000 7fd1d8a77fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.481+0000 7fd1d8a77fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:23:25.645 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.485+0000 7fd1d8a77fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:23:25.646 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.486+0000 7fd1d8a77fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:23:25.646 INFO:journalctl@ceph.mgr.z.trial187.stdout:Feb 13 01:23:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-z[28790]: 2026-02-13T01:23:25.487+0000 7fd1d8a77fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:23:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.644+0000 7fef99fe36c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 0x7fef94137aa0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef8c00a820 tx=0x7fef8c00ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.644+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef8c003c40 con 0x7fef94060640 2026-02-13T01:23:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.644+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef8c00a070 con 0x7fef94060640 2026-02-13T01:23:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.644+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef84009590 con 0x7fef94060640 2026-02-13T01:23:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9418a090 con 0x7fef94060640 2026-02-13T01:23:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef8c005250 con 0x7fef94060640 2026-02-13T01:23:25.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c4005310 con 0x7f88f8060d80 2026-02-13T01:23:25.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.647+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88e0007550 con 0x7f88f8060d80 2026-02-13T01:23:25.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.648+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fd7d4113f70 con 0x7fd7d405d830 2026-02-13T01:23:25.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.651+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64005310 con 0x7fef94060640 2026-02-13T01:23:25.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.651+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fef8c0053b0 con 0x7fef94060640 2026-02-13T01:23:25.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.652+0000 7fef8a7fc6c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fef7403f8f0 0x7fef7405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.652+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fef8c0525f0 con 0x7fef94060640 2026-02-13T01:23:25.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.653+0000 7fef997e26c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fef7403f8f0 0x7fef7405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.654+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fef8c011690 con 0x7fef94060640 2026-02-13T01:23:25.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.655+0000 7fef997e26c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fef7403f8f0 0x7fef7405fda0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef90004750 tx=0x7fef90009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.663+0000 7fd7d1ffb6c0 1 -- 10.20.193.28:0/4056466844 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v25)=0 v25) ==== 111+0+0 (secure 0 0 0) 0x7fd7c40086b0 con 0x7fd7d405d830 2026-02-13T01:23:25.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f4d0410f7c0 con 0x7f4d041554e0 2026-02-13T01:23:25.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd7a403f940 msgr2=0x7fd7a405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd7a403f940 0x7fd7a405fdf0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7c8005980 tx=0x7fd7c8005910 comp rx=0 tx=0).stop 2026-02-13T01:23:25.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 msgr2=0x7fd7d4155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4155d60 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7c400a3c0 tx=0x7fd7c400ced0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 shutdown_connections 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd7a403f940 0x7fd7a405fdf0 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd7d4135980 0x7fd7d4176680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd7d41562a0 0x7fd7d40ff960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 --2- 10.20.193.28:0/4056466844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7d405d830 0x7fd7d4155d60 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.667+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 >> 10.20.193.28:0/4056466844 conn(0x7fd7d405b8e0 msgr2=0x7fd7d40f5790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.668+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 shutdown_connections 2026-02-13T01:23:25.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.668+0000 7fd7dae146c0 1 -- 10.20.193.28:0/4056466844 wait complete. 2026-02-13T01:23:25.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.671+0000 7f4d017fa6c0 1 -- 10.20.193.28:0/2281449185 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7f4cf800b8a0 con 0x7f4d041554e0 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/1631358084 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf81133c0 msgr2=0x7f0cf81137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/1631358084 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf81133c0 0x7f0cf81137b0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=14298803399324577823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8009970 tx=0x7f0ce802ed70 comp rx=0 tx=0).stop 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/1631358084 shutdown_connections 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/1631358084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114ef0 0x7f0cf8175880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/1631358084 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0cf8114540 0x7f0cf81149b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/1631358084 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf81133c0 0x7f0cf81137b0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=14298803399324577823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/1631358084 >> 10.20.193.28:0/1631358084 conn(0x7f0cf80642f0 msgr2=0x7f0cf8064710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/1631358084 shutdown_connections 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.643+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/1631358084 wait complete. 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.644+0000 7f0cff8cc6c0 1 Processor -- start 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.644+0000 7f0cff8cc6c0 1 -- start start 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cff8cc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0cf81133c0 0x7f0cf80fe150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cff8cc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 0x7f0cf8175880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cff8cc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf8114ef0 0x7f0cf80fe9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cff8cc6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80ff5e0 con 0x7f0cf8114540 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cff8cc6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80ff750 con 0x7f0cf81133c0 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cff8cc6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80ff910 con 0x7f0cf8114ef0 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cfce406c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 0x7f0cf8175880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cfce406c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 0x7f0cf8175880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51326/0 (socket says 10.20.193.28:51326) 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cfde426c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf8114ef0 0x7f0cf80fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.645+0000 7f0cfce406c0 1 -- 10.20.193.28:0/2542509345 learned_addr learned my addr 10.20.193.28:0/2542509345 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfd6416c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0cf81133c0 0x7f0cf80fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfce406c0 1 -- 10.20.193.28:0/2542509345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf8114ef0 msgr2=0x7f0cf80fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfce406c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf8114ef0 0x7f0cf80fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfce406c0 1 -- 10.20.193.28:0/2542509345 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0cf81133c0 msgr2=0x7f0cf80fe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfce406c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0cf81133c0 0x7f0cf80fe150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfce406c0 1 -- 10.20.193.28:0/2542509345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf400a5b0 con 0x7f0cf8114540 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cfce406c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 0x7f0cf8175880 secure :-1 s=READY pgs=117 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec009490 tx=0x7f0cec00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0cec004a80 con 0x7f0cf8114540 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.646+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce8009590 con 0x7f0cf8114540 2026-02-13T01:23:25.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.647+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf80fff40 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.647+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0cec009030 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.647+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0cec0071c0 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.647+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc0005310 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.649+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f0cec007350 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.649+0000 7f0ce67fc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0cd403f940 0x7f0cd405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.649+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f0cec052410 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.650+0000 7f0cfd6416c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0cd403f940 0x7f0cd405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.650+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0cec00d040 con 0x7f0cf8114540 2026-02-13T01:23:25.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.651+0000 7f0cfd6416c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0cd403f940 0x7f0cd405fdf0 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce80023e0 tx=0x7f0ce8005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4cd403f8c0 msgr2=0x7f4cd405fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4cd403f8c0 0x7f4cd405fd70 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf0005b40 tx=0x7f4cf0009310 comp rx=0 tx=0).stop 2026-02-13T01:23:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d041554e0 msgr2=0x7f4d0410df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d041554e0 0x7f4d0410df90 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf80313c0 tx=0x7f4cf80055e0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 shutdown_connections 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4cd403f8c0 0x7f4cd405fd70 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d041554e0 0x7f4d0410df90 unknown :-1 s=CLOSED pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d04134920 0x7f4d0410d840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 --2- 10.20.193.28:0/2281449185 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d04113f70 0x7f4d041758c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 >> 10.20.193.28:0/2281449185 conn(0x7f4d0405b8e0 msgr2=0x7f4d04114340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 shutdown_connections 2026-02-13T01:23:25.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.692+0000 7f4d0a2986c0 1 -- 10.20.193.28:0/2281449185 wait complete. 2026-02-13T01:23:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.722+0000 7f7d9effd6c0 1 -- 10.20.193.28:0/2663370001 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d9002fe10 con 0x7f7da40b68f0 2026-02-13T01:23:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.722+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2663370001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b68f0 msgr2=0x7f7da40b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.722+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2663370001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b68f0 0x7f7da40b6ce0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=14713307728364205260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d90009970 tx=0x7f7d9002ed30 comp rx=0 tx=0).stop 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2663370001 shutdown_connections 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2663370001 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7da40b7a70 0x7f7da40b7ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2663370001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b8420 0x7f7da4118db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2663370001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b68f0 0x7f7da40b6ce0 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=14713307728364205260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2663370001 >> 10.20.193.28:0/2663370001 conn(0x7f7da4094010 msgr2=0x7f7da40b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2663370001 shutdown_connections 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.725+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2663370001 wait complete. 2026-02-13T01:23:25.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 Processor -- start 2026-02-13T01:23:25.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 -- start start 2026-02-13T01:23:25.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b68f0 0x7f7da409ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 0x7f7da4118db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7da40b8420 0x7f7da40a07b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40a13e0 con 0x7f7da40b68f0 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40a1550 con 0x7f7da40b7a70 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7dac8d56c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40a1710 con 0x7f7da40b8420 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7d9f7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 0x7f7da4118db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7d9f7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 0x7f7da4118db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:33576/0 (socket says 10.20.193.28:33576) 2026-02-13T01:23:25.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.726+0000 7f7d9f7fe6c0 1 -- 10.20.193.28:0/2998125847 learned_addr learned my addr 10.20.193.28:0/2998125847 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:25.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.727+0000 7f7dad0d66c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7da40b8420 0x7f7da40a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.727+0000 7f7d9f7fe6c0 1 -- 10.20.193.28:0/2998125847 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7da40b8420 msgr2=0x7f7da40a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.727+0000 7f7d9f7fe6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7da40b8420 0x7f7da40a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.727+0000 7f7d9f7fe6c0 1 -- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b68f0 msgr2=0x7f7da409ff50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:25.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.729+0000 7f7d9ffff6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b68f0 0x7f7da409ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.729+0000 7f7d9f7fe6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b68f0 0x7f7da409ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.729+0000 7f7d9f7fe6c0 1 -- 10.20.193.28:0/2998125847 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d980094c0 con 0x7f7da40b7a70 2026-02-13T01:23:25.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.729+0000 7f7d9ffff6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b68f0 0x7f7da409ff50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:25.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.729+0000 7f7d9f7fe6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 0x7f7da4118db0 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da0006f00 tx=0x7f7da0015770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.732+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da0003810 con 0x7f7da40b7a70 2026-02-13T01:23:25.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.732+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d90009590 con 0x7f7da40b7a70 2026-02-13T01:23:25.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.732+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da40a1d90 con 0x7f7da40b7a70 2026-02-13T01:23:25.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.732+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7da0003e50 con 0x7f7da40b7a70 2026-02-13T01:23:25.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.732+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da00146d0 con 0x7f7da40b7a70 2026-02-13T01:23:25.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.732+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3f800062b0 con 0x7f3f80007040 2026-02-13T01:23:25.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.733+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f7da00081c0 con 0x7f7da40b7a70 2026-02-13T01:23:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.737+0000 7f3f777fe6c0 1 -- 10.20.193.28:0/2800137754 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f3f78030030 con 0x7f3f80007040 2026-02-13T01:23:25.738 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.557+0000 7f56d4a28fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:23:25.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f7d9d7fa6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7d8c03f8f0 0x7f7d8c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3f5c03f940 msgr2=0x7f3f5c05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3f5c03f940 0x7f3f5c05fdf0 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f84005b40 tx=0x7f3f84009310 comp rx=0 tx=0).stop 2026-02-13T01:23:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 msgr2=0x7f3f801701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 0x7f3f801701f0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f780023c0 tx=0x7f3f780044b0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f7da005be70 con 0x7f7da40b7a70 2026-02-13T01:23:25.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.741+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d74005310 con 0x7f7da40b7a70 2026-02-13T01:23:25.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.746+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7da001ba00 con 0x7f7da40b7a70 2026-02-13T01:23:25.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.753+0000 7f7d9ffff6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7d8c03f8f0 0x7f7d8c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:25.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.753+0000 7f7d9ffff6c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7d8c03f8f0 0x7f7d8c05fda0 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d9002f240 tx=0x7f7d900023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:25.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 shutdown_connections 2026-02-13T01:23:25.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.754+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f61180051d0 con 0x7f615010e780 2026-02-13T01:23:25.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.757+0000 7f613e7fc6c0 1 -- 10.20.193.28:0/3888987754 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f614c013030 con 0x7f615010e780 2026-02-13T01:23:25.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.760+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f612c03f8f0 msgr2=0x7f612c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.760+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f612c03f8f0 0x7f612c05fda0 secure :-1 s=READY pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6140004750 tx=0x7f6140009310 comp rx=0 tx=0).stop 2026-02-13T01:23:25.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.760+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 msgr2=0x7f61500f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 0x7f61500f8e10 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f614c006ea0 tx=0x7f614c00ced0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 shutdown_connections 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f612c03f8f0 0x7f612c05fda0 unknown :-1 s=CLOSED pgs=66 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615010ddd0 0x7f615016f0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615010e780 0x7f61500f8e10 unknown :-1 s=CLOSED pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 --2- 10.20.193.28:0/3888987754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615010cc50 0x7f61500f85d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 >> 10.20.193.28:0/3888987754 conn(0x7f61500ea370 msgr2=0x7f61500ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.761+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 shutdown_connections 2026-02-13T01:23:25.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.762+0000 7f61576ff6c0 1 -- 10.20.193.28:0/3888987754 wait complete. 2026-02-13T01:23:25.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.767+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f49bc0051d0 con 0x7f49ec0c4f70 2026-02-13T01:23:25.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.771+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f91e0175ec0 con 0x7f91e010c940 2026-02-13T01:23:25.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3f5c03f940 0x7f3f5c05fdf0 unknown :-1 s=CLOSED pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3f800079f0 0x7f3f80170de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f80007040 0x7f3f801701f0 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 --2- 10.20.193.28:0/2800137754 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3f80005ec0 0x7f3f8016fba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 >> 10.20.193.28:0/2800137754 conn(0x7f3f800a0f30 msgr2=0x7f3f800c1310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 shutdown_connections 2026-02-13T01:23:25.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.758+0000 7f3f8eb8e6c0 1 -- 10.20.193.28:0/2800137754 wait complete. 2026-02-13T01:23:25.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.773+0000 7f91dd7fa6c0 1 -- 10.20.193.28:0/981528443 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7f91d4012720 con 0x7f91e010c940 2026-02-13T01:23:25.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.775+0000 7f49e27fc6c0 1 -- 10.20.193.28:0/1552326923 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f49e8011060 con 0x7f49ec0c4f70 2026-02-13T01:23:25.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f91b003f8f0 msgr2=0x7f91b005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f91b003f8f0 0x7f91b005fda0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91cc009b20 tx=0x7f91cc0023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010c940 msgr2=0x7f91e016d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010c940 0x7f91e016d2d0 secure :-1 s=READY pgs=116 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d4006fd0 tx=0x7f91d400cec0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 shutdown_connections 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f91b003f8f0 0x7f91b005fda0 unknown :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f91e010bf90 0x7f91e017d5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.776+0000 7f91e65686c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91e010c940 0x7f91e016d2d0 unknown :-1 s=CLOSED pgs=116 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.777+0000 7f91e65686c0 1 --2- 10.20.193.28:0/981528443 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f91e010ae10 0x7f91e017d000 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.777+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 >> 10.20.193.28:0/981528443 conn(0x7f91e00e8510 msgr2=0x7f91e01088f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.777+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 shutdown_connections 2026-02-13T01:23:25.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.777+0000 7f91e65686c0 1 -- 10.20.193.28:0/981528443 wait complete. 2026-02-13T01:23:25.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.782+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f49d003f950 msgr2=0x7f49d005fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.782+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f49d003f950 0x7f49d005fe00 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49f4052b90 tx=0x7f49f4054450 comp rx=0 tx=0).stop 2026-02-13T01:23:25.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.782+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 msgr2=0x7f49ec136350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.782+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 0x7f49ec136350 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e800b710 tx=0x7f49e800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 shutdown_connections 2026-02-13T01:23:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f49d003f950 0x7f49d005fe00 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f49ec0c5920 0x7f49ec1262b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49ec0c4f70 0x7f49ec136350 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 --2- 10.20.193.28:0/1552326923 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49ec0c3df0 0x7f49ec135e10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 >> 10.20.193.28:0/1552326923 conn(0x7f49ec0a10b0 msgr2=0x7f49ec0c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 shutdown_connections 2026-02-13T01:23:25.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.787+0000 7f49fb9936c0 1 -- 10.20.193.28:0/1552326923 wait complete. 2026-02-13T01:23:25.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.790+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fef640055c0 con 0x7fef94060640 2026-02-13T01:23:25.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.800+0000 7fef8a7fc6c0 1 -- 10.20.193.28:0/3135687259 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7fef8c004030 con 0x7fef94060640 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:25.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2061368316' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2893409439' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2839445035' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3217008409' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4180570034' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: Standby manager daemon z started 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:25.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2918895400' entity='client.admin' 2026-02-13T01:23:25.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:25.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4056466844' entity='client.admin' 2026-02-13T01:23:25.847 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:25 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.822+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fef7403f8f0 msgr2=0x7fef7405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.822+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fef7403f8f0 0x7fef7405fda0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef90004750 tx=0x7fef90009260 comp rx=0 tx=0).stop 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.822+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 msgr2=0x7fef94137aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.822+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 0x7fef94137aa0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef8c00a820 tx=0x7fef8c00ce50 comp rx=0 tx=0).stop 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 shutdown_connections 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fef7403f8f0 0x7fef7405fda0 unknown :-1 s=CLOSED pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fef94060640 0x7fef94137aa0 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef9405f330 0x7fef94136ef0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 --2- 10.20.193.28:0/3135687259 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fef9405e1b0 0x7fef941368a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 >> 10.20.193.28:0/3135687259 conn(0x7fef9405b8e0 msgr2=0x7fef94066780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 shutdown_connections 2026-02-13T01:23:25.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.823+0000 7fef9ba716c0 1 -- 10.20.193.28:0/3135687259 wait complete. 2026-02-13T01:23:25.849 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.849 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.849 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.850 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.850 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.850 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial028') 2026-02-13T01:23:25.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.870+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f7d74005b40 con 0x7f7da40b7a70 2026-02-13T01:23:25.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.870+0000 7f7d9d7fa6c0 1 -- 10.20.193.28:0/2998125847 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f7da0004e60 con 0x7f7da40b7a70 2026-02-13T01:23:25.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.873+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7d8c03f8f0 msgr2=0x7f7d8c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.873+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7d8c03f8f0 0x7f7d8c05fda0 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d9002f240 tx=0x7f7d900023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.873+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 msgr2=0x7f7da4118db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.873+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 0x7f7da4118db0 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da0006f00 tx=0x7f7da0015770 comp rx=0 tx=0).stop 2026-02-13T01:23:25.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 shutdown_connections 2026-02-13T01:23:25.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7d8c03f8f0 0x7f7d8c05fda0 unknown :-1 s=CLOSED pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7da40b8420 0x7f7da40a07b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7da40b7a70 0x7f7da4118db0 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 --2- 10.20.193.28:0/2998125847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da40b68f0 0x7f7da409ff50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 >> 10.20.193.28:0/2998125847 conn(0x7f7da4094010 msgr2=0x7f7da4096060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 shutdown_connections 2026-02-13T01:23:25.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.874+0000 7f7dac8d56c0 1 -- 10.20.193.28:0/2998125847 wait complete. 2026-02-13T01:23:25.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.915+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f0cc00055c0 con 0x7f0cf8114540 2026-02-13T01:23:25.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.917+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f88c4005b40 con 0x7f88f8060d80 2026-02-13T01:23:25.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.918+0000 7f0ce67fc6c0 1 -- 10.20.193.28:0/2542509345 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v31)=0 v31) ==== 119+0+0 (secure 0 0 0) 0x7f0cec00f050 con 0x7f0cf8114540 2026-02-13T01:23:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.920+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0cd403f940 msgr2=0x7f0cd405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.920+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0cd403f940 0x7f0cd405fdf0 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce80023e0 tx=0x7f0ce8005c60 comp rx=0 tx=0).stop 2026-02-13T01:23:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.920+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 msgr2=0x7f0cf8175880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.920+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 0x7f0cf8175880 secure :-1 s=READY pgs=117 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec009490 tx=0x7f0cec00bed0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.922+0000 7f88d7fff6c0 1 -- 10.20.193.28:0/1676072175 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v32)=0 v32) ==== 120+0+0 (secure 0 0 0) 0x7f88e0010710 con 0x7f88f8060d80 2026-02-13T01:23:25.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88cc03f950 msgr2=0x7f88cc05fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88cc03f950 0x7f88cc05fe00 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ec004750 tx=0x7f88ec009310 comp rx=0 tx=0).stop 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 msgr2=0x7f88f811c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 0x7f88f811c740 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88e000b6c0 tx=0x7f88e000bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 shutdown_connections 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f88f810c590 0x7f88f811d980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88f80621c0 0x7f88f811cd90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f88cc03f950 0x7f88cc05fe00 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 --2- 10.20.193.28:0/1676072175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f88f8060d80 0x7f88f811c740 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 >> 10.20.193.28:0/1676072175 conn(0x7f88f80ea190 msgr2=0x7f88f810a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 shutdown_connections 2026-02-13T01:23:25.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.924+0000 7f88f7fff6c0 1 -- 10.20.193.28:0/1676072175 wait complete. 2026-02-13T01:23:25.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.934+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 shutdown_connections 2026-02-13T01:23:25.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.934+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0cd403f940 0x7f0cd405fdf0 unknown :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.934+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0cf8114ef0 0x7f0cf80fe9b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.934+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf8114540 0x7f0cf8175880 unknown :-1 s=CLOSED pgs=117 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.934+0000 7f0cff8cc6c0 1 --2- 10.20.193.28:0/2542509345 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0cf81133c0 0x7f0cf80fe150 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:25.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.934+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 >> 10.20.193.28:0/2542509345 conn(0x7f0cf80642f0 msgr2=0x7f0cf80f4580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.935+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 shutdown_connections 2026-02-13T01:23:25.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:25.935+0000 7f0cff8cc6c0 1 -- 10.20.193.28:0/2542509345 wait complete. 2026-02-13T01:23:26.019 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2061368316' entity='client.admin' 2026-02-13T01:23:26.020 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2893409439' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2839445035' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3217008409' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4180570034' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: Standby manager daemon z started 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.021 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2918895400' entity='client.admin' 2026-02-13T01:23:26.022 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:26.022 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4056466844' entity='client.admin' 2026-02-13T01:23:26.022 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:25 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.022 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:26.022 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2061368316' entity='client.admin' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2893409439' entity='client.admin' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.023 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2839445035' entity='client.admin' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3217008409' entity='client.admin' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4180570034' entity='client.admin' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: Standby manager daemon z started 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2918895400' entity='client.admin' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4056466844' entity='client.admin' 2026-02-13T01:23:26.024 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:25 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.818+0000 7f56d4a28fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.827+0000 7f56d4a28fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.833+0000 7f56d4a28fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.840+0000 7f56d4a28fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.846+0000 7f56d4a28fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.858+0000 7f56d4a28fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.883+0000 7f56d4a28fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.886+0000 7f56d4a28fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:23:26.025 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.887+0000 7f56d4a28fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.894+0000 7f56d4a28fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.932+0000 7f56d4a28fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.934+0000 7f56d4a28fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.938+0000 7f56d4a28fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.940+0000 7f56d4a28fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.940+0000 7f56d4a28fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.943+0000 7f56d4a28fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.944+0000 7f56d4a28fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.947+0000 7f56d4a28fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:23:26.026 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:25 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:25.950+0000 7f56d4a28fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:23:26.286 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.133+0000 7f56d4a28fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:23:26.286 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.133+0000 7f56d4a28fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:23:26.287 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.135+0000 7f56d4a28fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:23:26.287 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.137+0000 7f56d4a28fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:23:26.287 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.139+0000 7f56d4a28fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:23:26.287 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.139+0000 7f56d4a28fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:23:26.287 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.140+0000 7f56d4a28fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:23:26.287 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.288+0000 7f56d4a28fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:23:26.326 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.327 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.327 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.327 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.327 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.327 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.328 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.328 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.328 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.328 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '70ced355-087a-11f1-9708-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial028') 2026-02-13T01:23:26.331 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config dump 2026-02-13T01:23:26.552 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.317+0000 7f56d4a28fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:23:26.552 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.321+0000 7f56d4a28fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:23:26.552 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.321+0000 7f56d4a28fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:23:26.552 INFO:journalctl@ceph.mgr.y.trial134.stdout:Feb 13 01:23:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-y[29023]: 2026-02-13T01:23:26.322+0000 7f56d4a28fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:23:26.557 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:26.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/758617012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 msgr2=0x7ff1b41102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 --2- 10.20.193.28:0/758617012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41102e0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=11899453928601827286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff19c009970 tx=0x7ff19c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/758617012 shutdown_connections 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 --2- 10.20.193.28:0/758617012 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b4110820 0x7ff1b41711b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 --2- 10.20.193.28:0/758617012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41102e0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=11899453928601827286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 --2- 10.20.193.28:0/758617012 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b410ecf0 0x7ff1b410f0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/758617012 >> 10.20.193.28:0/758617012 conn(0x7ff1b40ec410 msgr2=0x7ff1b410c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/758617012 shutdown_connections 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/758617012 wait complete. 2026-02-13T01:23:26.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.759+0000 7ff1b3fff6c0 1 Processor -- start 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 -- start start 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b410ecf0 0x7ff1b4112090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41126e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b4110820 0x7ff1b41132d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4113a60 con 0x7ff1b410fe70 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4113bd0 con 0x7ff1b410ecf0 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b3fff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4113d90 con 0x7ff1b4110820 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41126e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49424/0 (socket says 10.20.193.28:49424) 2026-02-13T01:23:26.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 -- 10.20.193.28:0/2745285335 learned_addr learned my addr 10.20.193.28:0/2745285335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b2ffd6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b410ecf0 0x7ff1b4112090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b37fe6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b4110820 0x7ff1b41132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 -- 10.20.193.28:0/2745285335 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b4110820 msgr2=0x7ff1b41132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b4110820 0x7ff1b41132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 -- 10.20.193.28:0/2745285335 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b410ecf0 msgr2=0x7ff1b4112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b410ecf0 0x7ff1b4112090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b27fc6c0 1 -- 10.20.193.28:0/2745285335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c009590 con 0x7ff1b410fe70 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b37fe6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b4110820 0x7ff1b41132d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.760+0000 7ff1b2ffd6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b410ecf0 0x7ff1b4112090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.761+0000 7ff1b27fc6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41126e0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff19c0092e0 tx=0x7ff19c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:26.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.761+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff19c002ba0 con 0x7ff1b410fe70 2026-02-13T01:23:26.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.761+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/2745285335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b4114010 con 0x7ff1b410fe70 2026-02-13T01:23:26.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.761+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff19c007740 con 0x7ff1b410fe70 2026-02-13T01:23:26.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.761+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff19c033600 con 0x7ff1b410fe70 2026-02-13T01:23:26.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.761+0000 7ff1b3fff6c0 1 -- 10.20.193.28:0/2745285335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b4154560 con 0x7ff1b410fe70 2026-02-13T01:23:26.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.762+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b4064540 con 0x7ff1b410fe70 2026-02-13T01:23:26.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.764+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7ff19c002d00 con 0x7ff1b410fe70 2026-02-13T01:23:26.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.765+0000 7ff193fff6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff1840b55f0 0x7ff1840d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:26.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.766+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7ff19c105fa0 con 0x7ff1b410fe70 2026-02-13T01:23:26.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.766+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff19c0c9a20 con 0x7ff1b410fe70 2026-02-13T01:23:26.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.766+0000 7ff1b2ffd6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff1840b55f0 0x7ff1840d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:26.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.766+0000 7ff1b2ffd6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff1840b55f0 0x7ff1840d5aa0 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1a8004750 tx=0x7ff1a8009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:26.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.869+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff1b410f0e0 con 0x7ff1b410fe70 2026-02-13T01:23:26.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.869+0000 7ff193fff6c0 1 -- 10.20.193.28:0/2745285335 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v32) ==== 59+0+18868 (secure 0 0 0) 0x7ff19c0cd8a0 con 0x7ff1b410fe70 2026-02-13T01:23:26.870 INFO:teuthology.orchestra.run.trial028.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T01:23:26.870 INFO:teuthology.orchestra.run.trial028.stdout:global dev auth_debug true 2026-02-13T01:23:26.870 INFO:teuthology.orchestra.run.trial028.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_file true 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_journald false 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global basic log_to_stderr false 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_allow_pool_delete true 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T01:23:26.871 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_bug true 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_old_message true 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global dev ms_die_on_skipped_message false 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T01:23:26.872 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_mon 20/20 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_ms 1/1 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced debug_paxos 20/20 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T01:23:26.873 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced client_mount_timeout 30 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_client 20/20 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_mgr 20/20 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced debug_ms 1/1 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T01:23:26.874 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bdev_debug_aio true 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_bluefs 20/20 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_bluestore 20/20 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_ms 1/1 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_osd 20/20 2026-02-13T01:23:26.875 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_op_order true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_shutdown true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_max_omap_entries_per_request 10 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T01:23:26.876 INFO:teuthology.orchestra.run.trial028.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_mds 20/20 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T01:23:26.877 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced debug_ms 2/2 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_bal_split_size 100 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_debug_frag true 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_debug_scatterstat true 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds dev mds_verify_scatter true 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T01:23:26.878 INFO:teuthology.orchestra.run.trial028.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client advanced client_mount_timeout 600 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client advanced debug_client 20/20 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client advanced debug_ms 1/1 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T01:23:26.879 INFO:teuthology.orchestra.run.trial028.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T01:23:26.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff1840b55f0 msgr2=0x7ff1840d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:26.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff1840b55f0 0x7ff1840d5aa0 secure :-1 s=READY pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1a8004750 tx=0x7ff1a8009630 comp rx=0 tx=0).stop 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 msgr2=0x7ff1b41126e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41126e0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff19c0092e0 tx=0x7ff19c0045f0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 shutdown_connections 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff1840b55f0 0x7ff1840d5aa0 unknown :-1 s=CLOSED pgs=75 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff1b4110820 0x7ff1b41132d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff1b410fe70 0x7ff1b41126e0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 --2- 10.20.193.28:0/2745285335 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff1b410ecf0 0x7ff1b4112090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 >> 10.20.193.28:0/2745285335 conn(0x7ff1b40ec410 msgr2=0x7ff1b410c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 shutdown_connections 2026-02-13T01:23:26.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:26.871+0000 7ff191ffb6c0 1 -- 10.20.193.28:0/2745285335 wait complete. 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2800137754' entity='client.admin' 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3888987754' entity='client.admin' 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1552326923' entity='client.admin' 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2542509345' entity='client.admin' 2026-02-13T01:23:26.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: Standby manager daemon y started 2026-02-13T01:23:26.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: mgrmap e9: x(active, since 36s), standbys: z, y 2026-02-13T01:23:26.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:23:26.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:23:26.974 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T01:23:26.974 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:23:26.974 DEBUG:teuthology.orchestra.run.trial028:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:23:27.013 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:23:27.014 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_1 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2800137754' entity='client.admin' 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3888987754' entity='client.admin' 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1552326923' entity='client.admin' 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2542509345' entity='client.admin' 2026-02-13T01:23:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: Standby manager daemon y started 2026-02-13T01:23:27.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: mgrmap e9: x(active, since 36s), standbys: z, y 2026-02-13T01:23:27.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:23:27.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:23:27.092 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:23:27.092 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:27.092 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1092 Links: 1 2026-02-13T01:23:27.093 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:27.093 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:27.093 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-13 01:23:00.675965451 +0000 2026-02-13T01:23:27.093 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-13 01:20:44.741646243 +0000 2026-02-13T01:23:27.093 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-13 01:20:44.741646243 +0000 2026-02-13T01:23:27.093 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-13 01:20:44.741646243 +0000 2026-02-13T01:23:27.093 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:23:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2800137754' entity='client.admin' 2026-02-13T01:23:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3888987754' entity='client.admin' 2026-02-13T01:23:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1552326923' entity='client.admin' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2542509345' entity='client.admin' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:27.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:27.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: Standby manager daemon y started 2026-02-13T01:23:27.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: mgrmap e9: x(active, since 36s), standbys: z, y 2026-02-13T01:23:27.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:23:27.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:23:27.185 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-13T01:23:27.186 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-13T01:23:27.186 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.00024221 s, 2.1 MB/s 2026-02-13T01:23:27.188 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:23:27.227 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_2 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1072 Links: 1 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-13 01:23:00.675965451 +0000 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-13 01:20:44.734931508 +0000 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-13 01:20:44.734931508 +0000 2026-02-13T01:23:27.306 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-13 01:20:44.734931508 +0000 2026-02-13T01:23:27.306 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:23:27.400 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-13T01:23:27.400 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-13T01:23:27.400 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000217644 s, 2.4 MB/s 2026-02-13T01:23:27.403 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:23:27.442 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_3 2026-02-13T01:23:27.520 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1085 Links: 1 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-13 01:23:00.675965451 +0000 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-13 01:20:44.738809220 +0000 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-13 01:20:44.738809220 +0000 2026-02-13T01:23:27.521 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-13 01:20:44.738809220 +0000 2026-02-13T01:23:27.522 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:23:27.614 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-13T01:23:27.614 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-13T01:23:27.615 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.00031752 s, 1.6 MB/s 2026-02-13T01:23:27.617 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:23:27.655 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_4 2026-02-13T01:23:27.734 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:23:27.734 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:27.734 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1077 Links: 1 2026-02-13T01:23:27.734 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:27.735 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:27.735 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-13 01:23:00.675965451 +0000 2026-02-13T01:23:27.735 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-13 01:20:44.736646329 +0000 2026-02-13T01:23:27.735 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-13 01:20:44.736646329 +0000 2026-02-13T01:23:27.735 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-13 01:20:44.736646329 +0000 2026-02-13T01:23:27.735 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:23:27.826 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-13T01:23:27.827 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-13T01:23:27.827 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000211914 s, 2.4 MB/s 2026-02-13T01:23:27.829 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:23:27.869 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-13T01:23:27.869 DEBUG:teuthology.orchestra.run.trial134:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:23:27.887 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:23:27.888 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_1 2026-02-13T01:23:27.944 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:23:27.944 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-13 01:23:25.341709196 +0000 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-13 01:20:42.178201580 +0000 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-13 01:20:42.178201580 +0000 2026-02-13T01:23:27.945 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-13 01:20:42.178201580 +0000 2026-02-13T01:23:27.945 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:23:28.008 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:28.008 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2745285335' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:23:28.009 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.009 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.009 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.009 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.009 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.009 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.011 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-13T01:23:28.011 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-13T01:23:28.012 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000173434 s, 3.0 MB/s 2026-02-13T01:23:28.013 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:23:28.070 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_2 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-13 01:23:25.342709183 +0000 2026-02-13T01:23:28.126 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-13 01:20:42.179201568 +0000 2026-02-13T01:23:28.127 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-13 01:20:42.179201568 +0000 2026-02-13T01:23:28.127 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-13 01:20:42.179201568 +0000 2026-02-13T01:23:28.127 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2745285335' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.190 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-13T01:23:28.190 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-13T01:23:28.191 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000148818 s, 3.4 MB/s 2026-02-13T01:23:28.192 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2745285335' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:28.250 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_3 2026-02-13T01:23:28.306 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:23:28.306 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-13 01:23:25.342709183 +0000 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-13 01:20:42.179201568 +0000 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-13 01:20:42.179201568 +0000 2026-02-13T01:23:28.307 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-13 01:20:42.179201568 +0000 2026-02-13T01:23:28.307 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:23:28.369 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-13T01:23:28.369 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-13T01:23:28.369 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.00016027 s, 3.2 MB/s 2026-02-13T01:23:28.371 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:23:28.428 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_4 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-13 01:23:25.342709183 +0000 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-13 01:20:42.178201580 +0000 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-13 01:20:42.178201580 +0000 2026-02-13T01:23:28.486 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-13 01:20:42.178201580 +0000 2026-02-13T01:23:28.487 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:23:28.549 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-13T01:23:28.550 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-13T01:23:28.550 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000131687 s, 3.9 MB/s 2026-02-13T01:23:28.551 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:23:28.608 DEBUG:teuthology.orchestra.run.trial187:> set -ex 2026-02-13T01:23:28.608 DEBUG:teuthology.orchestra.run.trial187:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:23:28.627 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:23:28.627 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_1 2026-02-13T01:23:28.685 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:23:28.685 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:28.685 INFO:teuthology.orchestra.run.trial187.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-13T01:23:28.685 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:28.686 INFO:teuthology.orchestra.run.trial187.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:28.686 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 01:23:24.525131123 +0000 2026-02-13T01:23:28.686 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:28.686 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:28.686 INFO:teuthology.orchestra.run.trial187.stdout: Birth: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:28.686 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:23:28.751 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T01:23:28.751 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T01:23:28.752 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.00016575 s, 3.1 MB/s 2026-02-13T01:23:28.753 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:23:28.810 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_2 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 01:23:24.526131119 +0000 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 01:20:43.811573404 +0000 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 01:20:43.811573404 +0000 2026-02-13T01:23:28.866 INFO:teuthology.orchestra.run.trial187.stdout: Birth: 2026-02-13 01:20:43.811573404 +0000 2026-02-13T01:23:28.867 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:23:28.930 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T01:23:28.930 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T01:23:28.930 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000143789 s, 3.6 MB/s 2026-02-13T01:23:28.931 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:23:28.990 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_3 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 01:23:24.526131119 +0000 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:29.047 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:29.048 INFO:teuthology.orchestra.run.trial187.stdout: Birth: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:29.048 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:23:29.111 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T01:23:29.111 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T01:23:29.112 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000223658 s, 2.3 MB/s 2026-02-13T01:23:29.113 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:23:29.170 DEBUG:teuthology.orchestra.run.trial187:> stat /dev/vg_nvme/lv_4 2026-02-13T01:23:29.226 INFO:teuthology.orchestra.run.trial187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:23:29.226 INFO:teuthology.orchestra.run.trial187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout:Access: 2026-02-13 01:23:24.527131116 +0000 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout:Modify: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout:Change: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:29.227 INFO:teuthology.orchestra.run.trial187.stdout: Birth: 2026-02-13 01:20:43.810573404 +0000 2026-02-13T01:23:29.228 DEBUG:teuthology.orchestra.run.trial187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:23:29.289 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records in 2026-02-13T01:23:29.289 INFO:teuthology.orchestra.run.trial187.stderr:1+0 records out 2026-02-13T01:23:29.289 INFO:teuthology.orchestra.run.trial187.stderr:512 bytes copied, 0.000143048 s, 3.6 MB/s 2026-02-13T01:23:29.290 DEBUG:teuthology.orchestra.run.trial187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:23:29.348 INFO:tasks.cephadm:Deploying osd.0 on trial028 with /dev/vg_nvme/lv_4... 2026-02-13T01:23:29.348 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:23:29.531 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:29.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:29 trial028 ceph-mon[22984]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:30.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:29 trial134 ceph-mon[27948]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:30.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:29 trial187 ceph-mon[27464]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:30.380 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:23:30.407 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_4 --skip-validation 2026-02-13T01:23:30.592 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:30.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/180507662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc10fe70 msgr2=0x7fb3dc1102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:30.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/180507662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1102e0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=4724496027573351080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d0009970 tx=0x7fb3d002ed10 comp rx=0 tx=0).stop 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/180507662 shutdown_connections 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/180507662 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc110820 0x7fb3dc1711b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/180507662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1102e0 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=4724496027573351080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/180507662 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 0x7fb3dc10f0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/180507662 >> 10.20.193.28:0/180507662 conn(0x7fb3dc0ec410 msgr2=0x7fb3dc10c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/180507662 shutdown_connections 2026-02-13T01:23:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.795+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/180507662 wait complete. 2026-02-13T01:23:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 Processor -- start 2026-02-13T01:23:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 -- start start 2026-02-13T01:23:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 0x7fb3dc0f8390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1711b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc110820 0x7fb3dc0f8bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0f9820 con 0x7fb3dc110820 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0f9990 con 0x7fb3dc10fe70 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e2cae6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0f9b50 con 0x7fb3dc10ecf0 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e1cac6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 0x7fb3dc0f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e14ab6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e24ad6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc110820 0x7fb3dc0f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e14ab6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:37710/0 (socket says 10.20.193.28:37710) 2026-02-13T01:23:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.796+0000 7fb3e14ab6c0 1 -- 10.20.193.28:0/470011527 learned_addr learned my addr 10.20.193.28:0/470011527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:30.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e24ad6c0 1 -- 10.20.193.28:0/470011527 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 msgr2=0x7fb3dc0f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:30.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e24ad6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 0x7fb3dc0f8390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:30.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e24ad6c0 1 -- 10.20.193.28:0/470011527 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc10fe70 msgr2=0x7fb3dc1711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:30.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e24ad6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:30.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e24ad6c0 1 -- 10.20.193.28:0/470011527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d0009590 con 0x7fb3dc110820 2026-02-13T01:23:30.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e1cac6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 0x7fb3dc0f8390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:30.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e24ad6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc110820 0x7fb3dc0f8bf0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d8006fd0 tx=0x7fb3d800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:30.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3d8003c40 con 0x7fb3dc110820 2026-02-13T01:23:30.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb3d800a070 con 0x7fb3dc110820 2026-02-13T01:23:30.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3d800dd90 con 0x7fb3dc110820 2026-02-13T01:23:30.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc0f9e30 con 0x7fb3dc110820 2026-02-13T01:23:30.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.797+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3dc0fa2c0 con 0x7fb3dc110820 2026-02-13T01:23:30.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.798+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3dc175210 con 0x7fb3dc110820 2026-02-13T01:23:30.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.800+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7fb3d8005030 con 0x7fb3dc110820 2026-02-13T01:23:30.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.802+0000 7fb3caffd6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb3b80b55f0 0x7fb3b80d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:30.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.802+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fb3d80e2c50 con 0x7fb3dc110820 2026-02-13T01:23:30.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.802+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3d80e30f0 con 0x7fb3dc110820 2026-02-13T01:23:30.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.802+0000 7fb3e1cac6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb3b80b55f0 0x7fb3b80d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.803+0000 7fb3e1cac6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb3b80b55f0 0x7fb3b80d5aa0 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3cc004750 tx=0x7fb3cc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:30.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:30.907+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb3dc0f1260 con 0x7fb3b80b55f0 2026-02-13T01:23:32.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:32.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:32.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:32.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:32.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:32.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:32 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/944694892' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b609cc73-d28a-4ba8-9724-13ee6cc98de8"} : dispatch 2026-02-13T01:23:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:32 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/944694892' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b609cc73-d28a-4ba8-9724-13ee6cc98de8"}]': finished 2026-02-13T01:23:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:32 trial028 ceph-mon[22984]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T01:23:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:32 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/614377281' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:33.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:32 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/944694892' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b609cc73-d28a-4ba8-9724-13ee6cc98de8"} : dispatch 2026-02-13T01:23:33.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:32 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/944694892' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b609cc73-d28a-4ba8-9724-13ee6cc98de8"}]': finished 2026-02-13T01:23:33.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:32 trial134 ceph-mon[27948]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T01:23:33.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:33.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:32 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/614377281' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:33.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:32 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/944694892' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b609cc73-d28a-4ba8-9724-13ee6cc98de8"} : dispatch 2026-02-13T01:23:33.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:32 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/944694892' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b609cc73-d28a-4ba8-9724-13ee6cc98de8"}]': finished 2026-02-13T01:23:33.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:32 trial187 ceph-mon[27464]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T01:23:33.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:33.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:32 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/614377281' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:33 trial028 ceph-mon[22984]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:34.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:33 trial134 ceph-mon[27948]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:34.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:33 trial187 ceph-mon[27464]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:35 trial028 ceph-mon[22984]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:23:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:35 trial134 ceph-mon[27948]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:23:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:35 trial187 ceph-mon[27464]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:23:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:36 trial028 ceph-mon[22984]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:36 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:37.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:36 trial134 ceph-mon[27948]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:37.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:36 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:36 trial187 ceph-mon[27464]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:36 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:38.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:38 trial028 ceph-mon[22984]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:38.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:38.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:38.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:38 trial134 ceph-mon[27948]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:39.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:38 trial187 ceph-mon[27464]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:39.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:40.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.365+0000 7fb3caffd6c0 1 -- 10.20.193.28:0/470011527 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb3dc0f1260 con 0x7fb3b80b55f0 2026-02-13T01:23:40.365 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 0 on host 'trial028' 2026-02-13T01:23:40.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.368+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb3b80b55f0 msgr2=0x7fb3b80d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.368+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb3b80b55f0 0x7fb3b80d5aa0 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3cc004750 tx=0x7fb3cc009260 comp rx=0 tx=0).stop 2026-02-13T01:23:40.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.368+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc110820 msgr2=0x7fb3dc0f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.368+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc110820 0x7fb3dc0f8bf0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3d8006fd0 tx=0x7fb3d800cc00 comp rx=0 tx=0).stop 2026-02-13T01:23:40.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 shutdown_connections 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb3dc110820 0x7fb3dc0f8bf0 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb3dc10fe70 0x7fb3dc1711b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb3b80b55f0 0x7fb3b80d5aa0 unknown :-1 s=CLOSED pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 --2- 10.20.193.28:0/470011527 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb3dc10ecf0 0x7fb3dc0f8390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 >> 10.20.193.28:0/470011527 conn(0x7fb3dc0ec410 msgr2=0x7fb3dc0ee950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 shutdown_connections 2026-02-13T01:23:40.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:40.369+0000 7fb3e2cae6c0 1 -- 10.20.193.28:0/470011527 wait complete. 2026-02-13T01:23:40.509 DEBUG:teuthology.orchestra.run.trial028:osd.0> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.0.service 2026-02-13T01:23:40.512 INFO:tasks.cephadm:Deploying osd.1 on trial134 with /dev/vg_nvme/lv_4... 2026-02-13T01:23:40.513 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:23:40.631 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:23:40.789 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:40.790 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:40.791 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:40.791 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:23:40.791 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:40.791 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.077 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:23:41.093 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial134:vg_nvme/lv_4 --skip-validation 2026-02-13T01:23:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:23:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.189 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:41.190 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:41.191 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:41.191 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:23:41.191 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.191 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:41.210 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:23:41.332 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/3347651325 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 msgr2=0x7fc5941104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.332 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/3347651325 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc5941104c0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=6049036287716853730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc57c009970 tx=0x7fc57c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:41.332 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/3347651325 shutdown_connections 2026-02-13T01:23:41.332 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/3347651325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594110a00 0x7fc594171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.333 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/3347651325 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc5941104c0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=6049036287716853730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.333 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/3347651325 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc59410eed0 0x7fc59410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.333 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/3347651325 >> 10.20.193.134:0/3347651325 conn(0x7fc5940ec5f0 msgr2=0x7fc59410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:41.333 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/3347651325 shutdown_connections 2026-02-13T01:23:41.333 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/3347651325 wait complete. 2026-02-13T01:23:41.333 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 Processor -- start 2026-02-13T01:23:41.334 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- start start 2026-02-13T01:23:41.334 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc59410eed0 0x7fc5940f85a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.334 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc594171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.334 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594110a00 0x7fc5940f8de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.334 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc5940f9a30 con 0x7fc594110a00 2026-02-13T01:23:41.335 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc5940f9ba0 con 0x7fc594110050 2026-02-13T01:23:41.335 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc59bbdc6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc5940f9d60 con 0x7fc59410eed0 2026-02-13T01:23:41.335 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc5991506c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc594171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.335 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc5991506c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc594171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.134:42242/0 (socket says 10.20.193.134:42242) 2026-02-13T01:23:41.335 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc5991506c0 1 -- 10.20.193.134:0/4152309404 learned_addr learned my addr 10.20.193.134:0/4152309404 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-13T01:23:41.335 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.332+0000 7fc5999516c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc59410eed0 0x7fc5940f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc59a1526c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594110a00 0x7fc5940f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc5991506c0 1 -- 10.20.193.134:0/4152309404 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc59410eed0 msgr2=0x7fc5940f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc5991506c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc59410eed0 0x7fc5940f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc5991506c0 1 -- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594110a00 msgr2=0x7fc5940f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc5991506c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594110a00 0x7fc5940f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc5991506c0 1 -- 10.20.193.134:0/4152309404 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c009590 con 0x7fc594110050 2026-02-13T01:23:41.336 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc5991506c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc594171370 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc57c0092e0 tx=0x7fc57c0045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:41.337 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc57c002ba0 con 0x7fc594110050 2026-02-13T01:23:41.337 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5940f9f80 con 0x7fc594110050 2026-02-13T01:23:41.337 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc57c007740 con 0x7fc594110050 2026-02-13T01:23:41.337 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc57c0366a0 con 0x7fc594110050 2026-02-13T01:23:41.337 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5940fa450 con 0x7fc594110050 2026-02-13T01:23:41.337 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.333+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5940fa670 con 0x7fc594110050 2026-02-13T01:23:41.339 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.334+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7fc57c002d00 con 0x7fc594110050 2026-02-13T01:23:41.339 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.335+0000 7fc592ffd6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc55c0b5570 0x7fc55c0d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:41.340 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.335+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1141+0+0 (secure 0 0 0) 0x7fc57c105f50 con 0x7fc594110050 2026-02-13T01:23:41.340 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.335+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc57c0ca590 con 0x7fc594110050 2026-02-13T01:23:41.340 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.335+0000 7fc5999516c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc55c0b5570 0x7fc55c0d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:41.340 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.336+0000 7fc5999516c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc55c0b5570 0x7fc55c0d5a20 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc580004750 tx=0x7fc580009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:41.428 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:41.430+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fc5940fa670 con 0x7fc55c0b5570 2026-02-13T01:23:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:23:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:23:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:23:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:42.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:23:42.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:23:42.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:42.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:23:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:23:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:23:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:23:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:42.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:42.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:42.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:42.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:42.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:42.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.197 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0[34315]: 2026-02-13T01:23:41.781+0000 7f9b5168c6c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T01:23:42.197 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0[34315]: 2026-02-13T01:23:41.784+0000 7f9b4d5506c0 -1 osd.0 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:23:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:23:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"} : dispatch 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"}]': finished 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/1016766069' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"} : dispatch 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] boot 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:43.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:42 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/2311814434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:23:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"} : dispatch 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"}]': finished 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/1016766069' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"} : dispatch 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] boot 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:42 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/2311814434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"} : dispatch 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"}]': finished 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/1016766069' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b21607c-6340-49b2-ae85-eb92729919c2"} : dispatch 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: osd.0 [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] boot 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:43.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:43.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:43.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:43.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:43.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:42 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/2311814434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:43.932 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:43 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:23:43.933 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:43 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:23:43.933 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:43 trial134 ceph-mon[27948]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:43.933 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:43 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:43.933 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:43 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:23:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:43 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:23:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:43 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:23:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:43 trial187 ceph-mon[27464]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:43 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:43 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:23:44.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:43 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:23:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:43 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:23:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:43 trial028 ceph-mon[22984]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:43 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:43 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:45.018 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.019 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:45.019 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:45.019 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.019 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:23:45.019 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:45.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:45.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:45.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:23:45.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:23:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:46.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:45 trial134 ceph-mon[27948]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:45 trial134 ceph-mon[27948]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:45 trial134 ceph-mon[27948]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:45 trial187 ceph-mon[27464]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:45 trial187 ceph-mon[27464]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:45 trial187 ceph-mon[27464]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:45 trial028 ceph-mon[22984]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:45 trial028 ceph-mon[22984]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:45 trial028 ceph-mon[22984]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:46.977 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:46 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:46.978 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:46.978 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:46.978 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:46 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:46 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:47.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:47.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.503 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.505+0000 7fc592ffd6c0 1 -- 10.20.193.134:0/4152309404 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc5940fa670 con 0x7fc55c0b5570 2026-02-13T01:23:47.504 INFO:teuthology.orchestra.run.trial134.stdout:Created osd(s) 1 on host 'trial134' 2026-02-13T01:23:47.506 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc55c0b5570 msgr2=0x7fc55c0d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.506 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc55c0b5570 0x7fc55c0d5a20 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc580004750 tx=0x7fc580009260 comp rx=0 tx=0).stop 2026-02-13T01:23:47.506 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 msgr2=0x7fc594171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.506 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc594171370 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc57c0092e0 tx=0x7fc57c0045f0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 shutdown_connections 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc594110a00 0x7fc5940f8de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc594110050 0x7fc594171370 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc55c0b5570 0x7fc55c0d5a20 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 --2- 10.20.193.134:0/4152309404 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc59410eed0 0x7fc5940f85a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 >> 10.20.193.134:0/4152309404 conn(0x7fc5940ec5f0 msgr2=0x7fc5940eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 shutdown_connections 2026-02-13T01:23:47.507 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:23:47.508+0000 7fc59bbdc6c0 1 -- 10.20.193.134:0/4152309404 wait complete. 2026-02-13T01:23:47.546 DEBUG:teuthology.orchestra.run.trial134:osd.1> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.1.service 2026-02-13T01:23:47.549 INFO:tasks.cephadm:Deploying osd.2 on trial187 with /dev/vg_nvme/lv_4... 2026-02-13T01:23:47.549 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:23:47.669 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:23:47.825 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:47.825 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.825 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.825 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:47.826 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:48.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:48.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.124 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:23:48.141 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial187:vg_nvme/lv_4 --skip-validation 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:48.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:48.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:48.261 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:23:48.379 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/3148574446 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810e780 msgr2=0x7f44c816f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:48.379 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/3148574446 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810e780 0x7f44c816f110 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=12056256637737860458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44bc00aa40 tx=0x7f44bc02fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/3148574446 shutdown_connections 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/3148574446 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810e780 0x7f44c816f110 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=12056256637737860458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/3148574446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f44c810ddd0 0x7f44c810e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/3148574446 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810cc50 0x7f44c810d040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/3148574446 >> 10.20.193.187:0/3148574446 conn(0x7f44c80ea370 msgr2=0x7f44c810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/3148574446 shutdown_connections 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/3148574446 wait complete. 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.379+0000 7f44cf73c6c0 1 Processor -- start 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 -- start start 2026-02-13T01:23:48.380 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 0x7f44c8061ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810ddd0 0x7f44c816f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f44c810e780 0x7f44c80607a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8060dc0 con 0x7f44c810e780 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8060f30 con 0x7f44c810ddd0 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80610f0 con 0x7f44c810cc50 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 0x7f44c8061ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 0x7f44c8061ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.187:47238/0 (socket says 10.20.193.187:47238) 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 -- 10.20.193.187:0/887382561 learned_addr learned my addr 10.20.193.187:0/887382561 (peer_addr_for_me v2:10.20.193.187:0/0) 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cdcb26c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f44c810e780 0x7f44c80607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cccb06c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810ddd0 0x7f44c816f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.381 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 -- 10.20.193.187:0/887382561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810ddd0 msgr2=0x7f44c816f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810ddd0 0x7f44c816f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 -- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f44c810e780 msgr2=0x7f44c80607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f44c810e780 0x7f44c80607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 -- 10.20.193.187:0/887382561 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc00a660 con 0x7f44c810cc50 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cccb06c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810ddd0 0x7f44c816f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cd4b16c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 0x7f44c8061ea0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b400b6c0 tx=0x7f44b400bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44b40044a0 con 0x7f44c810cc50 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f44b4009030 con 0x7f44c810cc50 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44b400cc60 con 0x7f44c810cc50 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c80613d0 con 0x7f44c810cc50 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.380+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c80fa560 con 0x7f44c810cc50 2026-02-13T01:23:48.382 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.381+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c81731c0 con 0x7f44c810cc50 2026-02-13T01:23:48.384 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.382+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7f44b40026b0 con 0x7f44c810cc50 2026-02-13T01:23:48.384 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.382+0000 7f44c67fc6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f44900b5570 0x7f44900d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:48.384 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.383+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1681+0+0 (secure 0 0 0) 0x7f44b40e1f80 con 0x7f44c810cc50 2026-02-13T01:23:48.384 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.383+0000 7f44cccb06c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f44900b5570 0x7f44900d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:48.384 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.383+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f44b40a63a0 con 0x7f44c810cc50 2026-02-13T01:23:48.384 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.383+0000 7f44cccb06c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f44900b5570 0x7f44900d5a20 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b0004750 tx=0x7f44b0006e70 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:48.475 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:48.478+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f44c80edad0 con 0x7f44900b5570 2026-02-13T01:23:49.048 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.049 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.050 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.113 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:23:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:49.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.302 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:49 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1[32733]: 2026-02-13T01:23:49.049+0000 7fe1456136c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T01:23:49.302 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:49 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1[32733]: 2026-02-13T01:23:49.052+0000 7fe1414d76c0 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"} : dispatch 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"}]': finished 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/152414905' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"} : dispatch 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] boot 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/77532798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:50.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:49 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:23:50.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:50.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:50.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:23:50.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"}]': finished 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/152414905' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] boot 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/77532798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:50.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:50.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:49 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"} : dispatch 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"}]': finished 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/152414905' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f3ebd5b-92a4-4b56-b83b-1ef57483f823"} : dispatch 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: osd.1 [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] boot 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/77532798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:50.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:49 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:51.487 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.488 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:51.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:52.293 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:52 trial187 ceph-mon[27464]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.293 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:52 trial187 ceph-mon[27464]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.293 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:52 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:23:52.293 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:52 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:52.293 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:52 trial187 ceph-mon[27464]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:52 trial134 ceph-mon[27948]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:52 trial134 ceph-mon[27948]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:52 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:23:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:52 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:52 trial134 ceph-mon[27948]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:52 trial028 ceph-mon[22984]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:52 trial028 ceph-mon[22984]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:52.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:52 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:23:52.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:52 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:52.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:52 trial028 ceph-mon[22984]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:53.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:53 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:53.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:53 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:53.695 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:53 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:54.391 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.393+0000 7f44c67fc6c0 1 -- 10.20.193.187:0/887382561 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f44c80edad0 con 0x7f44900b5570 2026-02-13T01:23:54.391 INFO:teuthology.orchestra.run.trial187.stdout:Created osd(s) 2 on host 'trial187' 2026-02-13T01:23:54.394 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f44900b5570 msgr2=0x7f44900d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.394 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f44900b5570 0x7f44900d5a20 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b0004750 tx=0x7f44b0006e70 comp rx=0 tx=0).stop 2026-02-13T01:23:54.394 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 msgr2=0x7f44c8061ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.394 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 0x7f44c8061ea0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b400b6c0 tx=0x7f44b400bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 shutdown_connections 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f44c810e780 0x7f44c80607a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f44c810ddd0 0x7f44c816f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f44900b5570 0x7f44900d5a20 unknown :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 --2- 10.20.193.187:0/887382561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f44c810cc50 0x7f44c8061ea0 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 >> 10.20.193.187:0/887382561 conn(0x7f44c80ea370 msgr2=0x7f44c80ec300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 shutdown_connections 2026-02-13T01:23:54.395 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:23:54.396+0000 7f44cf73c6c0 1 -- 10.20.193.187:0/887382561 wait complete. 2026-02-13T01:23:54.434 DEBUG:teuthology.orchestra.run.trial187:osd.2> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.2.service 2026-02-13T01:23:54.436 INFO:tasks.cephadm:Deploying osd.3 on trial028 with /dev/vg_nvme/lv_3... 2026-02-13T01:23:54.436 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:23:54.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:54.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.537 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:54.538 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:54 trial187 ceph-mon[27464]: from='osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:54.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:54.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:54.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:54.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:54 trial134 ceph-mon[27948]: from='osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:54.624 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:54.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:54.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:54.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:54.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:54 trial028 ceph-mon[22984]: from='osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:55.468 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:23:55.493 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_3 --skip-validation 2026-02-13T01:23:55.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:55.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:23:55.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:55.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:23:55.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:55 trial028 ceph-mon[22984]: from='osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:23:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:55 trial134 ceph-mon[27948]: from='osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:23:55.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:55.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:23:55.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:23:55.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:55 trial187 ceph-mon[27464]: from='osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:23:55.679 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:23:55.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 -- 10.20.193.28:0/3118191830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 msgr2=0x7f77e81757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/3118191830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 0x7f77e81757c0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=2050511352556427891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77dc00aa40 tx=0x7f77dc02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 -- 10.20.193.28:0/3118191830 shutdown_connections 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/3118191830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 0x7f77e81757c0 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=2050511352556427891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/3118191830 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f77e8114120 0x7f77e8114570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/3118191830 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e8113b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 -- 10.20.193.28:0/3118191830 >> 10.20.193.28:0/3118191830 conn(0x7f77e8064120 msgr2=0x7f77e8064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 -- 10.20.193.28:0/3118191830 shutdown_connections 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.887+0000 7f77eccde6c0 1 -- 10.20.193.28:0/3118191830 wait complete. 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 Processor -- start 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 -- start start 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e80fe900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f77e8114120 0x7f77e81757c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 0x7f77e80ff160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f77e80ffd90 con 0x7f77e8114cb0 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77e80fff00 con 0x7f77e8114120 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77eccde6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f77e81000c0 con 0x7f77e81137a0 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77e6ffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f77e8114120 0x7f77e81757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77e7fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 0x7f77e80ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77e77fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e80fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77e77fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e80fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:37052/0 (socket says 10.20.193.28:37052) 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.888+0000 7f77e77fe6c0 1 -- 10.20.193.28:0/2231214995 learned_addr learned my addr 10.20.193.28:0/2231214995 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e77fe6c0 1 -- 10.20.193.28:0/2231214995 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f77e8114120 msgr2=0x7f77e81757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e77fe6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f77e8114120 0x7f77e81757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e77fe6c0 1 -- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 msgr2=0x7f77e80ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e77fe6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 0x7f77e80ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e77fe6c0 1 -- 10.20.193.28:0/2231214995 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc00a660 con 0x7f77e81137a0 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e77fe6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e80fe900 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d4009490 tx=0x7f77d400bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77d4004a80 con 0x7f77e81137a0 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e81003a0 con 0x7f77e81137a0 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f77d4009030 con 0x7f77e81137a0 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77d400ce50 con 0x7f77e81137a0 2026-02-13T01:23:55.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.889+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e8100830 con 0x7f77e81137a0 2026-02-13T01:23:55.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.890+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8179730 con 0x7f77e81137a0 2026-02-13T01:23:55.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.892+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7f77d4004ce0 con 0x7f77e81137a0 2026-02-13T01:23:55.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.894+0000 7f77e4ff96c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f77bc0b5570 0x7f77bc0d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.894+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2221+0+0 (secure 0 0 0) 0x7f77d40e22d0 con 0x7f77e81137a0 2026-02-13T01:23:55.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.894+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77d40e2700 con 0x7f77e81137a0 2026-02-13T01:23:55.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.894+0000 7f77e6ffd6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f77bc0b5570 0x7f77bc0d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.894+0000 7f77e6ffd6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f77bc0b5570 0x7f77bc0d5a20 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d8004750 tx=0x7f77d8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:55.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:23:55.999+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f77e80f7740 con 0x7f77bc0b5570 2026-02-13T01:23:56.121 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:55 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2[32596]: 2026-02-13T01:23:55.947+0000 7f49105366c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T01:23:56.121 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:55 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2[32596]: 2026-02-13T01:23:55.950+0000 7f49083f26c0 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:56.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:56.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:56.395 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.396 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:56.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.555 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:56.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.557 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:57.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:23:57.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:23:57.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:57.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:57.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:57.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:57.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:23:57.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] boot 2026-02-13T01:23:57.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: osdmap e15: 3 total, 3 up, 3 in 2026-02-13T01:23:57.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:57.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2082053323' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f8c87696-e524-441f-b262-8f1b1b088b22"} : dispatch 2026-02-13T01:23:57.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:57 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2082053323' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8c87696-e524-441f-b262-8f1b1b088b22"}]': finished 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:23:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] boot 2026-02-13T01:23:57.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: osdmap e15: 3 total, 3 up, 3 in 2026-02-13T01:23:57.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:57.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2082053323' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f8c87696-e524-441f-b262-8f1b1b088b22"} : dispatch 2026-02-13T01:23:57.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:57 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2082053323' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8c87696-e524-441f-b262-8f1b1b088b22"}]': finished 2026-02-13T01:23:57.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:23:57.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:23:57.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:57.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:57.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: osd.2 [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] boot 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: osdmap e15: 3 total, 3 up, 3 in 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2082053323' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f8c87696-e524-441f-b262-8f1b1b088b22"} : dispatch 2026-02-13T01:23:57.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:57 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2082053323' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8c87696-e524-441f-b262-8f1b1b088b22"}]': finished 2026-02-13T01:23:58.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:58 trial134 ceph-mon[27948]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T01:23:58.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:58.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:58 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3387035801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:58.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:58.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:58 trial187 ceph-mon[27464]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T01:23:58.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:58.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:58 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3387035801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:58.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:58.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:58 trial028 ceph-mon[22984]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T01:23:58.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:58.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:58 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3387035801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:58.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39306]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39306]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39306]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39310]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39310]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.559 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.560 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39310]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 ceph-mon[22984]: pgmap v53: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 ceph-mon[22984]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39410]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39410]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.560 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39410]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.597 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 ceph-mon[27464]: pgmap v53: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:59.597 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:59.598 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 ceph-mon[27464]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:23:59.598 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:59.598 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:59.598 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35925]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:23:59.598 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35925]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.598 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.598 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35925]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.598 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35929]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:23:59.599 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35929]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.599 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.599 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35929]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.641 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 ceph-mon[27948]: pgmap v53: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:59.641 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:59.641 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 ceph-mon[27948]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:23:59.641 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:59.641 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35779]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35779]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35779]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35783]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35783]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.642 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35783]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35933]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:23:59.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35933]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35937]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:23:59.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35937]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:23:59 trial187 sudo[35937]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:59.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39414]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:23:59.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39414]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:59.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:59.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:23:59 trial028 sudo[39414]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:24:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T01:24:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:24:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:24:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35787]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:24:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35791]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T01:24:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35791]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:24:00.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:24:00.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:23:59 trial134 sudo[35791]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:24:00.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:24:00.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:24:00.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:24:00.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:00.686+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f77d40a6100 con 0x7f77e81137a0 2026-02-13T01:24:00.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:24:00.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:24:00.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:00.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:00.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:24:00.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:24:00.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:24:00.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:24:00.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:24:00.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: mgrmap e10: x(active, since 70s), standbys: z, y 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:24:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:01.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:24:01.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:01.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:01.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: mgrmap e10: x(active, since 70s), standbys: z, y 2026-02-13T01:24:01.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:24:01.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: mgrmap e10: x(active, since 70s), standbys: z, y 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:24:01.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.585 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:03 trial028 ceph-mon[22984]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:03.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:03 trial187 ceph-mon[27464]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:03.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:03 trial134 ceph-mon[27948]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:04.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:04.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:04.590 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:04.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:04.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:04.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:04.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:04.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:04.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:05 trial028 ceph-mon[22984]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:05.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:05 trial028 ceph-mon[22984]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:24:05.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.547+0000 7f77e4ff96c0 1 -- 10.20.193.28:0/2231214995 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f77e80f7740 con 0x7f77bc0b5570 2026-02-13T01:24:05.547 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 3 on host 'trial028' 2026-02-13T01:24:05.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f77bc0b5570 msgr2=0x7f77bc0d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f77bc0b5570 0x7f77bc0d5a20 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d8004750 tx=0x7f77d8009260 comp rx=0 tx=0).stop 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 msgr2=0x7f77e80fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e80fe900 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d4009490 tx=0x7f77d400bc50 comp rx=0 tx=0).stop 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 shutdown_connections 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f77e8114cb0 0x7f77e80ff160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f77e8114120 0x7f77e81757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f77bc0b5570 0x7f77bc0d5a20 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 --2- 10.20.193.28:0/2231214995 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f77e81137a0 0x7f77e80fe900 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 >> 10.20.193.28:0/2231214995 conn(0x7f77e8064120 msgr2=0x7f77e80f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 shutdown_connections 2026-02-13T01:24:05.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:05.549+0000 7f77eccde6c0 1 -- 10.20.193.28:0/2231214995 wait complete. 2026-02-13T01:24:05.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:05 trial187 ceph-mon[27464]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:05.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:05 trial187 ceph-mon[27464]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:24:05.657 DEBUG:teuthology.orchestra.run.trial028:osd.3> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.3.service 2026-02-13T01:24:05.661 INFO:tasks.cephadm:Deploying osd.4 on trial134 with /dev/vg_nvme/lv_3... 2026-02-13T01:24:05.661 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:24:05.687 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:05 trial134 ceph-mon[27948]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:05.687 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.687 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:05.687 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:05 trial134 ceph-mon[27948]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:24:05.781 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:24:06.237 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:24:06.253 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial134:vg_nvme/lv_3 --skip-validation 2026-02-13T01:24:06.411 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/2770109813 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 msgr2=0x7f3cc81104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/2770109813 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc81104b0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=5002992463452258452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cac009970 tx=0x7f3cac02ed50 comp rx=0 tx=0).stop 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/2770109813 shutdown_connections 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/2770109813 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 0x7f3cc8171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/2770109813 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc81104b0 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=5002992463452258452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/2770109813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cc810eec0 0x7f3cc810f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.538+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/2770109813 >> 10.20.193.134:0/2770109813 conn(0x7f3cc80ec5c0 msgr2=0x7f3cc810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:06.539 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/2770109813 shutdown_connections 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/2770109813 wait complete. 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 Processor -- start 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- start start 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cc810eec0 0x7f3cc80f85f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc8171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 0x7f3cc80f8e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc80f9a80 con 0x7f3cc810eec0 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc80f9bf0 con 0x7f3cc8110040 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc80f9db0 con 0x7f3cc81109f0 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc8171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.540 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc8171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.134:41906/0 (socket says 10.20.193.134:41906) 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 -- 10.20.193.134:0/3078221121 learned_addr learned my addr 10.20.193.134:0/3078221121 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc75776c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 0x7f3cc80f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 -- 10.20.193.134:0/3078221121 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 msgr2=0x7f3cc80f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 0x7f3cc80f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 -- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cc810eec0 msgr2=0x7f3cc80f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cc810eec0 0x7f3cc80f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 -- 10.20.193.134:0/3078221121 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac009590 con 0x7f3cc8110040 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc75776c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 0x7f3cc80f8e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cc65756c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc8171380 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cac02ff00 tx=0x7f3cac004650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cac002ba0 con 0x7f3cc8110040 2026-02-13T01:24:06.541 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3cac002d00 con 0x7f3cc8110040 2026-02-13T01:24:06.542 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc80fa030 con 0x7f3cc8110040 2026-02-13T01:24:06.542 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cac031340 con 0x7f3cc8110040 2026-02-13T01:24:06.542 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.539+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc80fa500 con 0x7f3cc8110040 2026-02-13T01:24:06.542 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.540+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc8175410 con 0x7f3cc8110040 2026-02-13T01:24:06.543 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.541+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f3cac007990 con 0x7f3cc8110040 2026-02-13T01:24:06.543 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.542+0000 7f3cbffff6c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3c900b5680 0x7f3c900d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:06.543 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.542+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3150+0+0 (secure 0 0 0) 0x7f3cac106a20 con 0x7f3cc8110040 2026-02-13T01:24:06.543 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.542+0000 7f3cc6d766c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3c900b5680 0x7f3c900d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:06.543 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.542+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3cac0ca7b0 con 0x7f3cc8110040 2026-02-13T01:24:06.544 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.543+0000 7f3cc6d766c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3c900b5680 0x7f3c900d5b30 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cb4004750 tx=0x7f3cb4006d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:06.636 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:06.637+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f3cc804ca20 con 0x7f3c900b5680 2026-02-13T01:24:06.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:06.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:06.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:06 trial134 ceph-mon[27948]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:24:06.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:06 trial134 ceph-mon[27948]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:24:06.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:06 trial134 ceph-mon[27948]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:06.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:06.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:06.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:06.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:06 trial187 ceph-mon[27464]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:24:06.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:06 trial187 ceph-mon[27464]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:24:06.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:06 trial187 ceph-mon[27464]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:06.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:06.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:06.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:06.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:06 trial028 ceph-mon[22984]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:24:06.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:06 trial028 ceph-mon[22984]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:24:06.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:06 trial028 ceph-mon[22984]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:06.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.446 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:24:07 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3[40188]: 2026-02-13T01:24:07.103+0000 7f7975d196c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T01:24:07.446 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:24:07 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3[40188]: 2026-02-13T01:24:07.108+0000 7f796dbd56c0 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:07.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:07.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:07.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:07.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/960520495' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"} : dispatch 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"}]': finished 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] boot 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T01:24:07.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.805 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:07.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"} : dispatch 2026-02-13T01:24:07.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/960520495' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"} : dispatch 2026-02-13T01:24:07.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"}]': finished 2026-02-13T01:24:07.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] boot 2026-02-13T01:24:07.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T01:24:07.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:24:07.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:07.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"} : dispatch 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/960520495' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"} : dispatch 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "181c4948-a9b0-4bf5-bb9a-5071865e44ce"}]': finished 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: osd.3 [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] boot 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:24:07.948 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:08.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:24:08.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:24:08.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:08.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/3050266578' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:08.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:08.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:08.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:24:08.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:08 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:08.918 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/3050266578' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:24:08.919 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:08 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:08.945 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/3050266578' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:24:08.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.554 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:10 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:10 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:10.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:10.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:10.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:10 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:11.695 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:11 trial028 ceph-mon[22984]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:24:11.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:11 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:11.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:11 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:11.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:11 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:11.785 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:11 trial134 ceph-mon[27948]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:24:11.785 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:11 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:11.786 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:11 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:11.786 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:11 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:11.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:11 trial187 ceph-mon[27464]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:24:11.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:11 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:11.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:11 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:11.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:11 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:12.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:12 trial028 ceph-mon[22984]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:24:12.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:12.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:12.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:12.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:12 trial028 ceph-mon[22984]: pgmap v72: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T01:24:12.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:12.711 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:12 trial134 ceph-mon[27948]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:24:12.712 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:12.712 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:12.712 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:12.712 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:12 trial134 ceph-mon[27948]: pgmap v72: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T01:24:12.712 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:12.793 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.794+0000 7f3cbffff6c0 1 -- 10.20.193.134:0/3078221121 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f3cc804ca20 con 0x7f3c900b5680 2026-02-13T01:24:12.793 INFO:teuthology.orchestra.run.trial134.stdout:Created osd(s) 4 on host 'trial134' 2026-02-13T01:24:12.795 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3c900b5680 msgr2=0x7f3c900d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.795 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3c900b5680 0x7f3c900d5b30 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cb4004750 tx=0x7f3cb4006d50 comp rx=0 tx=0).stop 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 msgr2=0x7f3cc8171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc8171380 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cac02ff00 tx=0x7f3cac004650 comp rx=0 tx=0).stop 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 shutdown_connections 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3c900b5680 0x7f3c900d5b30 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3cc81109f0 0x7f3cc80f8e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3cc8110040 0x7f3cc8171380 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 --2- 10.20.193.134:0/3078221121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3cc810eec0 0x7f3cc80f85f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 >> 10.20.193.134:0/3078221121 conn(0x7f3cc80ec5c0 msgr2=0x7f3cc80eeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 shutdown_connections 2026-02-13T01:24:12.796 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:12.797+0000 7f3ccd1b76c0 1 -- 10.20.193.134:0/3078221121 wait complete. 2026-02-13T01:24:12.836 DEBUG:teuthology.orchestra.run.trial134:osd.4> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.4.service 2026-02-13T01:24:12.838 INFO:tasks.cephadm:Deploying osd.5 on trial187 with /dev/vg_nvme/lv_3... 2026-02-13T01:24:12.838 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:24:12.863 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:12 trial187 ceph-mon[27464]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:24:12.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:12.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:12.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:12.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:12 trial187 ceph-mon[27464]: pgmap v72: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T01:24:12.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:12.959 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:24:13.397 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:24:13.415 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial187:vg_nvme/lv_3 --skip-validation 2026-02-13T01:24:13.571 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:24:13.691 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 -- 10.20.193.187:0/971183742 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa330110a00 msgr2=0x7fa330171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/971183742 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa330110a00 0x7fa330171390 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=16826444353842322379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa32400aa40 tx=0x7fa32402fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 -- 10.20.193.187:0/971183742 shutdown_connections 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/971183742 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa330110a00 0x7fa330171390 unknown :-1 s=CLOSED pgs=34 gs=1 cs=0 l=1 c_cookie=16826444353842322379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/971183742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110050 0x7fa3301104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/971183742 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa33010eed0 0x7fa33010f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 -- 10.20.193.187:0/971183742 >> 10.20.193.187:0/971183742 conn(0x7fa3300ec5f0 msgr2=0x7fa33010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 -- 10.20.193.187:0/971183742 shutdown_connections 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.691+0000 7fa3379f96c0 1 -- 10.20.193.187:0/971183742 wait complete. 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 Processor -- start 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 -- start start 2026-02-13T01:24:13.692 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 0x7fa3300f8530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa330110050 0x7fa330171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110a00 0x7fa3300f8d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3300f99c0 con 0x7fa330110a00 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa3300f9b30 con 0x7fa330110050 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa3300f9cf0 con 0x7fa33010eed0 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 0x7fa3300f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 0x7fa3300f8530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.187:36166/0 (socket says 10.20.193.187:36166) 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 -- 10.20.193.187:0/3536156513 learned_addr learned my addr 10.20.193.187:0/3536156513 (peer_addr_for_me v2:10.20.193.187:0/0) 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa334f696c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa330110050 0x7fa330171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa335f6b6c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110a00 0x7fa3300f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:13.693 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 -- 10.20.193.187:0/3536156513 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa330110050 msgr2=0x7fa330171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa330110050 0x7fa330171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 -- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110a00 msgr2=0x7fa3300f8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110a00 0x7fa3300f8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 -- 10.20.193.187:0/3536156513 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32400a660 con 0x7fa33010eed0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa335f6b6c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110a00 0x7fa3300f8d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa33576a6c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 0x7fa3300f8530 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa31c005dc0 tx=0x7fa31c00bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa31c004250 con 0x7fa33010eed0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa31c009070 con 0x7fa33010eed0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3300f9f70 con 0x7fa33010eed0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa31c00cde0 con 0x7fa33010eed0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.692+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3300fa400 con 0x7fa33010eed0 2026-02-13T01:24:13.694 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.693+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa330175410 con 0x7fa33010eed0 2026-02-13T01:24:13.695 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.694+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fa31c0028c0 con 0x7fa33010eed0 2026-02-13T01:24:13.696 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.694+0000 7fa32e7fc6c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2f80b5600 0x7fa2f80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:13.696 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.695+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3561+0+0 (secure 0 0 0) 0x7fa31c0e28d0 con 0x7fa33010eed0 2026-02-13T01:24:13.696 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.695+0000 7fa334f696c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2f80b5600 0x7fa2f80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:13.696 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.695+0000 7fa334f696c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2f80b5600 0x7fa2f80d5ab0 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa318005980 tx=0x7fa318005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:13.696 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.695+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa31c0a6500 con 0x7fa33010eed0 2026-02-13T01:24:13.790 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:13.793+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa3300eed50 con 0x7fa2f80b5600 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: pgmap v73: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 216 KiB/s, 0 objects/s recovering 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.791 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: pgmap v74: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 177 KiB/s, 0 objects/s recovering 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.792 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: pgmap v73: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 216 KiB/s, 0 objects/s recovering 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: pgmap v74: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 177 KiB/s, 0 objects/s recovering 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:13.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: pgmap v73: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 216 KiB/s, 0 objects/s recovering 2026-02-13T01:24:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: pgmap v74: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 177 KiB/s, 0 objects/s recovering 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:14.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:15.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: pgmap v75: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"}]': finished 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/1930483446' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: osdmap e28: 6 total, 4 up, 6 in 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:15.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.056 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:24:14 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4[38874]: 2026-02-13T01:24:14.601+0000 7fb89d8166c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T01:24:15.056 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:24:14 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4[38874]: 2026-02-13T01:24:14.605+0000 7fb8996da6c0 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: pgmap v75: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"}]': finished 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/1930483446' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: osdmap e28: 6 total, 4 up, 6 in 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:15.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: pgmap v75: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-13T01:24:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:24:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:24:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"} : dispatch 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"}]': finished 2026-02-13T01:24:15.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/1930483446' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "05fa2cf3-9b55-4589-9db7-f7f20c478be4"} : dispatch 2026-02-13T01:24:15.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: osdmap e28: 6 total, 4 up, 6 in 2026-02-13T01:24:15.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:15.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:15.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:16.016 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/3915297649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] boot 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:16.017 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:15 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/3915297649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] boot 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:15 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: pgmap v77: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/3915297649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: osd.4 [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] boot 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:16.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:15 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:16.782 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:16.782 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:16.783 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:16 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:16 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:16 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.876 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:17.877 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:17.877 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:17.877 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:24:17.877 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:17.877 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:24:17.877 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:24:18.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:24:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:18.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:18 trial187 ceph-mon[27464]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:18.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:18 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:19.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:18 trial134 ceph-mon[27948]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:19.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:18 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:19.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:18 trial028 ceph-mon[22984]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:18 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:19.847 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.849+0000 7fa32e7fc6c0 1 -- 10.20.193.187:0/3536156513 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa3300eed50 con 0x7fa2f80b5600 2026-02-13T01:24:19.847 INFO:teuthology.orchestra.run.trial187.stdout:Created osd(s) 5 on host 'trial187' 2026-02-13T01:24:19.850 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.851+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2f80b5600 msgr2=0x7fa2f80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.850 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.851+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2f80b5600 0x7fa2f80d5ab0 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa318005980 tx=0x7fa318005910 comp rx=0 tx=0).stop 2026-02-13T01:24:19.850 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 msgr2=0x7fa3300f8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:19.850 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 0x7fa3300f8530 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa31c005dc0 tx=0x7fa31c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.850 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 shutdown_connections 2026-02-13T01:24:19.850 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa330110a00 0x7fa3300f8d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.851 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa330110050 0x7fa330171370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.851 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2f80b5600 0x7fa2f80d5ab0 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.851 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 --2- 10.20.193.187:0/3536156513 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa33010eed0 0x7fa3300f8530 unknown :-1 s=CLOSED pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:19.851 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 >> 10.20.193.187:0/3536156513 conn(0x7fa3300ec5f0 msgr2=0x7fa3300ee520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:19.851 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 shutdown_connections 2026-02-13T01:24:19.851 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:19.852+0000 7fa3379f96c0 1 -- 10.20.193.187:0/3536156513 wait complete. 2026-02-13T01:24:19.889 DEBUG:teuthology.orchestra.run.trial187:osd.5> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.5.service 2026-02-13T01:24:19.891 INFO:tasks.cephadm:Deploying osd.6 on trial028 with /dev/vg_nvme/lv_2... 2026-02-13T01:24:19.892 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:24:20.013 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.013 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.013 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:20.014 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:20.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.082 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:20.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.125 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:20.125 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:20.125 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:20.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: from='osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:20.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:20 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.956 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:24:20.980 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_2 --skip-validation 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: from='osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.033 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:20 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: from='osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:20 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:21.168 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:24:21.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1699029592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa71010fe70 msgr2=0x7fa7101102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 --2- 10.20.193.28:0/1699029592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa71010fe70 0x7fa7101102e0 secure :-1 s=READY pgs=133 gs=3 cs=0 l=1 c_cookie=15558026080260800255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6f8009970 tx=0x7fa6f802ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1699029592 shutdown_connections 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 --2- 10.20.193.28:0/1699029592 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa710110820 0x7fa7101711b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 --2- 10.20.193.28:0/1699029592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa71010fe70 0x7fa7101102e0 unknown :-1 s=CLOSED pgs=133 gs=3 cs=0 l=1 c_cookie=15558026080260800255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 --2- 10.20.193.28:0/1699029592 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa71010ecf0 0x7fa71010f0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1699029592 >> 10.20.193.28:0/1699029592 conn(0x7fa7100ec410 msgr2=0x7fa71010c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1699029592 shutdown_connections 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.361+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1699029592 wait complete. 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 Processor -- start 2026-02-13T01:24:21.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 -- start start 2026-02-13T01:24:21.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa71010ecf0 0x7fa7100f83b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:21.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa71010fe70 0x7fa710171190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:21.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 0x7fa7100f8bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:21.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7100f9840 con 0x7fa710110820 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7100f99b0 con 0x7fa71010ecf0 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa7148df6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa7100f9b70 con 0x7fa71010fe70 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 0x7fa7100f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 0x7fa7100f8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39064/0 (socket says 10.20.193.28:39064) 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 -- 10.20.193.28:0/1510929428 learned_addr learned my addr 10.20.193.28:0/1510929428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70e5756c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa71010fe70 0x7fa710171190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70ed766c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa71010ecf0 0x7fa7100f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 -- 10.20.193.28:0/1510929428 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa71010fe70 msgr2=0x7fa710171190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa71010fe70 0x7fa710171190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 -- 10.20.193.28:0/1510929428 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa71010ecf0 msgr2=0x7fa7100f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa71010ecf0 0x7fa7100f83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:21.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 -- 10.20.193.28:0/1510929428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f8009590 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.362+0000 7fa70f5776c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 0x7fa7100f8bf0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa700006ea0 tx=0x7fa70000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.363+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa700003c40 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.363+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa700003da0 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.363+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7000081c0 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.363+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1510929428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7100f9df0 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.363+0000 7fa7148df6c0 1 -- 10.20.193.28:0/1510929428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7100fa280 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.364+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7101751e0 con 0x7fa710110820 2026-02-13T01:24:21.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.366+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fa70000d590 con 0x7fa710110820 2026-02-13T01:24:21.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.367+0000 7fa6effff6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6e40b5680 0x7fa6e40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:21.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.367+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4014+0+0 (secure 0 0 0) 0x7fa7000e3b70 con 0x7fa710110820 2026-02-13T01:24:21.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.368+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa70011c5e0 con 0x7fa710110820 2026-02-13T01:24:21.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.368+0000 7fa70ed766c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6e40b5680 0x7fa6e40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:21.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.368+0000 7fa70ed766c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6e40b5680 0x7fa6e40d5b30 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa704004750 tx=0x7fa704009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:21.474+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa71010f0e0 con 0x7fa6e40b5680 2026-02-13T01:24:21.893 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:24:21 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:24:21.740+0000 7f847eba76c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T01:24:21.894 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:24:21 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:24:21.744+0000 7f847aa6b6c0 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:21.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:21.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:21.896 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:21.897 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:21.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:24:21.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.997 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:21.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:21.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:21.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:21.999 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:24:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:24:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:22.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:22.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:22.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:22.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:22.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:22.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:22.885 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:22.886 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:22 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:23.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:23.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:23.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:22 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:24:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:24:23.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:23.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:23.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:23.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:22 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] boot 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3655660599' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb"} : dispatch 2026-02-13T01:24:24.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3655660599' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb"}]': finished 2026-02-13T01:24:24.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:24:24.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:24.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:23 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3744128646' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:24:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:24:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] boot 2026-02-13T01:24:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T01:24:24.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:24.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3655660599' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb"} : dispatch 2026-02-13T01:24:24.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3655660599' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb"}]': finished 2026-02-13T01:24:24.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:24:24.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:24.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:23 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3744128646' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: osd.5 [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] boot 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3655660599' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb"} : dispatch 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3655660599' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb"}]': finished 2026-02-13T01:24:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:24:24.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:24.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:23 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3744128646' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:25.013 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:24 trial028 ceph-mon[22984]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:25.013 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:24 trial028 ceph-mon[22984]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:24:25.013 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:25.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:24 trial134 ceph-mon[27948]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:25.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:24 trial134 ceph-mon[27948]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:24:25.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:24 trial187 ceph-mon[27464]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:24 trial187 ceph-mon[27464]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:24:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:25.814 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:25 trial028 ceph-mon[22984]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:24:25.814 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:26.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:25 trial134 ceph-mon[27948]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:24:26.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:26.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:25 trial187 ceph-mon[27464]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:24:26.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:27.030 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:26 trial028 ceph-mon[22984]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 148 KiB/s, 0 objects/s recovering 2026-02-13T01:24:27.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:26 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:27.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:26 trial028 ceph-mon[22984]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:24:27.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:27.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:24:27.031 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:26 trial134 ceph-mon[27948]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 148 KiB/s, 0 objects/s recovering 2026-02-13T01:24:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:26 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:26 trial134 ceph-mon[27948]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:24:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:24:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:26 trial187 ceph-mon[27464]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 148 KiB/s, 0 objects/s recovering 2026-02-13T01:24:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:26 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:26 trial187 ceph-mon[27464]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:24:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:24:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:28.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:27 trial134 ceph-mon[27948]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:24:28.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:28.086 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:27 trial028 ceph-mon[22984]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:24:28.086 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:27 trial187 ceph-mon[27464]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:24:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:29.044 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:28 trial187 ceph-mon[27464]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:29.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:28 trial134 ceph-mon[27948]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:29.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:28 trial028 ceph-mon[22984]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:31.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:30 trial134 ceph-mon[27948]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T01:24:31.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:31.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.071 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:30 trial028 ceph-mon[22984]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T01:24:31.071 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:31.072 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.072 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:30 trial187 ceph-mon[27464]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T01:24:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.191+0000 7fa6effff6c0 1 -- 10.20.193.28:0/1510929428 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa71010f0e0 con 0x7fa6e40b5680 2026-02-13T01:24:31.193 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 6 on host 'trial028' 2026-02-13T01:24:31.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.194+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6e40b5680 msgr2=0x7fa6e40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:31.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.194+0000 7fa6edffb6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6e40b5680 0x7fa6e40d5b30 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa704004750 tx=0x7fa704009260 comp rx=0 tx=0).stop 2026-02-13T01:24:31.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.194+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 msgr2=0x7fa7100f8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:31.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.194+0000 7fa6edffb6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 0x7fa7100f8bf0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa700006ea0 tx=0x7fa70000ce50 comp rx=0 tx=0).stop 2026-02-13T01:24:31.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 shutdown_connections 2026-02-13T01:24:31.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6e40b5680 0x7fa6e40d5b30 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa71010fe70 0x7fa710171190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa710110820 0x7fa7100f8bf0 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 --2- 10.20.193.28:0/1510929428 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa71010ecf0 0x7fa7100f83b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 >> 10.20.193.28:0/1510929428 conn(0x7fa7100ec410 msgr2=0x7fa7100ee9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 shutdown_connections 2026-02-13T01:24:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:31.195+0000 7fa6edffb6c0 1 -- 10.20.193.28:0/1510929428 wait complete. 2026-02-13T01:24:31.306 DEBUG:teuthology.orchestra.run.trial028:osd.6> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.6.service 2026-02-13T01:24:31.310 INFO:tasks.cephadm:Deploying osd.7 on trial134 with /dev/vg_nvme/lv_2... 2026-02-13T01:24:31.310 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:24:31.432 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.847 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 94 KiB/s, 0 objects/s recovering 2026-02-13T01:24:31.848 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:31.848 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:31.848 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.848 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.848 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 94 KiB/s, 0 objects/s recovering 2026-02-13T01:24:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:31.875 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:31.875 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.875 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.875 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:31.879 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:24:31.895 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial134:vg_nvme/lv_2 --skip-validation 2026-02-13T01:24:32.013 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:24:32.135 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- 10.20.193.134:0/1962377326 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c110040 msgr2=0x7fd23c1104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:32.135 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- 10.20.193.134:0/1962377326 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c110040 0x7fd23c1104b0 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=879405612445744316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd224009970 tx=0x7fd22402ed10 comp rx=0 tx=0).stop 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- 10.20.193.134:0/1962377326 shutdown_connections 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- 10.20.193.134:0/1962377326 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd23c1109f0 0x7fd23c171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- 10.20.193.134:0/1962377326 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c110040 0x7fd23c1104b0 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=879405612445744316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- 10.20.193.134:0/1962377326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd23c10eec0 0x7fd23c10f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- 10.20.193.134:0/1962377326 >> 10.20.193.134:0/1962377326 conn(0x7fd23c0ec5c0 msgr2=0x7fd23c10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- 10.20.193.134:0/1962377326 shutdown_connections 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- 10.20.193.134:0/1962377326 wait complete. 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 Processor -- start 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- start start 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd23c10eec0 0x7fd23c0f9010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:32.136 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd23c110040 0x7fd23c171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 0x7fd23c0f9870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0fa410 con 0x7fd23c10eec0 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0fa580 con 0x7fd23c1109f0 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.134+0000 7fd243c606c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0fa740 con 0x7fd23c110040 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 0x7fd23c0f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 0x7fd23c0f9870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.134:41276/0 (socket says 10.20.193.134:41276) 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 -- 10.20.193.134:0/743840929 learned_addr learned my addr 10.20.193.134:0/743840929 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2411d06c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd23c110040 0x7fd23c171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2419d16c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd23c10eec0 0x7fd23c0f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 -- 10.20.193.134:0/743840929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd23c110040 msgr2=0x7fd23c171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:32.137 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd23c110040 0x7fd23c171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 -- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd23c10eec0 msgr2=0x7fd23c0f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd23c10eec0 0x7fd23c0f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 -- 10.20.193.134:0/743840929 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd224009590 con 0x7fd23c1109f0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd2421d26c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 0x7fd23c0f9870 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd23000c730 tx=0x7fd23000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd230003c40 con 0x7fd23c1109f0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd23000a070 con 0x7fd23c1109f0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c0faa20 con 0x7fd23c1109f0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd23000dd40 con 0x7fd23c1109f0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c0faf00 con 0x7fd23c1109f0 2026-02-13T01:24:32.138 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.135+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c1753e0 con 0x7fd23c1109f0 2026-02-13T01:24:32.139 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.137+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fd230005030 con 0x7fd23c1109f0 2026-02-13T01:24:32.139 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.138+0000 7fd23affd6c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2040b5600 0x7fd2040d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:32.140 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.138+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4446+0+0 (secure 0 0 0) 0x7fd2300e3d60 con 0x7fd23c1109f0 2026-02-13T01:24:32.140 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.138+0000 7fd2419d16c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2040b5600 0x7fd2040d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:32.140 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.138+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2300a75e0 con 0x7fd23c1109f0 2026-02-13T01:24:32.140 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.139+0000 7fd2419d16c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2040b5600 0x7fd2040d5ab0 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd228004750 tx=0x7fd228005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 94 KiB/s, 0 objects/s recovering 2026-02-13T01:24:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.232 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:32.233+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd23c0efc90 con 0x7fd2040b5600 2026-02-13T01:24:32.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:24:32.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:24:32.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:32.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:32.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:32.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:24:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:24:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:24:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:24:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:33.198 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:24:32 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:24:32.783+0000 7f2afecf26c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T01:24:33.198 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:24:32 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:24:32.791+0000 7f2afabb66c0 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:34.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:34.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:24:34.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/382214374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"}]': finished 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] boot 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/4274728123' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:34.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:34.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:34.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:24:34.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T01:24:34.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/382214374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"}]': finished 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] boot 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/4274728123' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:34.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"} : dispatch 2026-02-13T01:24:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/382214374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83f5f6ed-fa57-4628-bcf0-49d51edea60d"}]': finished 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: osd.6 [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] boot 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/4274728123' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:34.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:34.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:34.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:34.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:34.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:35.031 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:34 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:24:35.031 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:34 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:24:35.031 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:34 trial134 ceph-mon[27948]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:35.031 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:34 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:35.031 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:34 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:34 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:24:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:34 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:24:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:34 trial187 ceph-mon[27464]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:34 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:34 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:34 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:24:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:34 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:24:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:34 trial028 ceph-mon[22984]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:34 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:34 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:35.817 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:24:35.817 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:35.817 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:35.817 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:35.817 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:24:35.818 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:24:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:24:36.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:36.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:36.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:36.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:24:36.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:37.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:36 trial134 ceph-mon[27948]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:37.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:36 trial134 ceph-mon[27948]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:37.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:36 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:37.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:36 trial187 ceph-mon[27464]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:37.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:36 trial187 ceph-mon[27464]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:37.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:36 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:37.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:36 trial028 ceph-mon[22984]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:36 trial028 ceph-mon[22984]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:36 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:37.886 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:37.886 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:37.886 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.493 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.494+0000 7fd23affd6c0 1 -- 10.20.193.134:0/743840929 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd23c0efc90 con 0x7fd2040b5600 2026-02-13T01:24:38.493 INFO:teuthology.orchestra.run.trial134.stdout:Created osd(s) 7 on host 'trial134' 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.496+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2040b5600 msgr2=0x7fd2040d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.496+0000 7fd243c606c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2040b5600 0x7fd2040d5ab0 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd228004750 tx=0x7fd228005e60 comp rx=0 tx=0).stop 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.496+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 msgr2=0x7fd23c0f9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.496+0000 7fd243c606c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 0x7fd23c0f9870 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd23000c730 tx=0x7fd23000cc00 comp rx=0 tx=0).stop 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 shutdown_connections 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2040b5600 0x7fd2040d5ab0 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd23c110040 0x7fd23c171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.496 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd23c1109f0 0x7fd23c0f9870 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.497 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 --2- 10.20.193.134:0/743840929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd23c10eec0 0x7fd23c0f9010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.497 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 >> 10.20.193.134:0/743840929 conn(0x7fd23c0ec5c0 msgr2=0x7fd23c0ef580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:38.497 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 shutdown_connections 2026-02-13T01:24:38.497 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:38.497+0000 7fd243c606c0 1 -- 10.20.193.134:0/743840929 wait complete. 2026-02-13T01:24:38.537 DEBUG:teuthology.orchestra.run.trial134:osd.7> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.7.service 2026-02-13T01:24:38.539 INFO:tasks.cephadm:Deploying osd.8 on trial187 with /dev/vg_nvme/lv_2... 2026-02-13T01:24:38.539 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:24:38.660 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:24:38.819 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:38.819 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.819 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:38.820 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:38.821 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.113 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:24:39.130 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial187:vg_nvme/lv_2 --skip-validation 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:39.248 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:24:39.367 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 -- 10.20.193.187:0/3342581737 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110a00 msgr2=0x7f36a8171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:39.367 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 --2- 10.20.193.187:0/3342581737 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110a00 0x7f36a8171390 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=15473900189569880421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f369800aa40 tx=0x7f369802fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:39.367 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 -- 10.20.193.187:0/3342581737 shutdown_connections 2026-02-13T01:24:39.367 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 --2- 10.20.193.187:0/3342581737 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110a00 0x7f36a8171390 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=15473900189569880421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:39.367 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 --2- 10.20.193.187:0/3342581737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a8110050 0x7f36a81104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 --2- 10.20.193.187:0/3342581737 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a810eed0 0x7f36a810f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 -- 10.20.193.187:0/3342581737 >> 10.20.193.187:0/3342581737 conn(0x7f36a80ec5f0 msgr2=0x7f36a810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 -- 10.20.193.187:0/3342581737 shutdown_connections 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 -- 10.20.193.187:0/3342581737 wait complete. 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 Processor -- start 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 -- start start 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a810eed0 0x7f36a80f8470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.367+0000 7f36aca316c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 0x7f36a8171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a8110a00 0x7f36a80f8cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80f9900 con 0x7f36a810eed0 2026-02-13T01:24:39.368 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80f9a70 con 0x7f36a8110a00 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80f9c30 con 0x7f36a8110050 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 0x7f36a8171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 0x7f36a8171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.187:39724/0 (socket says 10.20.193.187:39724) 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 -- 10.20.193.187:0/2397642555 learned_addr learned my addr 10.20.193.187:0/2397642555 (peer_addr_for_me v2:10.20.193.187:0/0) 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a65756c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a810eed0 0x7f36a80f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a6d766c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a8110a00 0x7f36a80f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 -- 10.20.193.187:0/2397642555 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a8110a00 msgr2=0x7f36a80f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a8110a00 0x7f36a80f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 -- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a810eed0 msgr2=0x7f36a80f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a810eed0 0x7f36a80f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:39.369 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 -- 10.20.193.187:0/2397642555 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369800a660 con 0x7f36a8110050 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a65756c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a810eed0 0x7f36a80f8470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a6d766c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a8110a00 0x7f36a80f8cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36a5d746c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 0x7f36a8171390 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f368c00b6c0 tx=0x7f368c00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f368c0044a0 con 0x7f36a8110050 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f368c00be50 con 0x7f36a8110050 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a80f9f10 con 0x7f36a8110050 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f368c00cdc0 con 0x7f36a8110050 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a80fa4c0 con 0x7f36a8110050 2026-02-13T01:24:39.370 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.368+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a8175440 con 0x7f36a8110050 2026-02-13T01:24:39.371 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.370+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f368c0026b0 con 0x7f36a8110050 2026-02-13T01:24:39.371 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.370+0000 7f369f7fe6c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f36700b5680 0x7f36700d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:39.372 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.371+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4878+0+0 (secure 0 0 0) 0x7f368c0e2c10 con 0x7f36a8110050 2026-02-13T01:24:39.372 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.371+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f368c0a6370 con 0x7f36a8110050 2026-02-13T01:24:39.372 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.371+0000 7f36a65756c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f36700b5680 0x7f36700d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:39.372 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.372+0000 7f36a65756c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f36700b5680 0x7f36700d5b30 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3694004750 tx=0x7f3694005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:39.465 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:39.467+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f36a80efd30 con 0x7f36700b5680 2026-02-13T01:24:40.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:40.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:40.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:40.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:24:40.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:24:40.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:40.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.109 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.110 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:40.111 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:40.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:40.112 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:40.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:40.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:40.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:40.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:40.552 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:24:40 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:24:40.087+0000 7f668718e6c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T01:24:40.552 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:24:40 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:24:40.093+0000 7f66830526c0 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"} : dispatch 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"}]': finished 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/3673583756' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"} : dispatch 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] boot 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/3573054423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:41.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:40 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"} : dispatch 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"}]': finished 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/3673583756' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"} : dispatch 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] boot 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:41.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/3573054423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:41.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:41.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:40 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"} : dispatch 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"}]': finished 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/3673583756' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "63963560-6c24-4627-aade-6d99ec304b7a"} : dispatch 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: osd.7 [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] boot 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/3573054423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:41.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:40 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:24:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:24:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:24:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:42.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.561 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.562 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:42.562 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.562 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:42.562 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:42.562 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:42.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:42.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:43.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:24:43.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:43.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:24:43.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:43.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:43 trial187 ceph-mon[27464]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:43 trial134 ceph-mon[27948]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:43 trial028 ceph-mon[22984]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:44.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:44 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:44.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:44 trial134 ceph-mon[27948]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:24:44.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:44.557 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:44 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:44.557 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:44 trial187 ceph-mon[27464]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:24:44.557 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:44.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:44 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:44.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:44 trial028 ceph-mon[22984]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:24:44.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:45 trial134 ceph-mon[27948]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:24:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:45 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:45 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:45 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:45 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:45 trial134 ceph-mon[27948]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:45.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:45 trial187 ceph-mon[27464]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:24:45.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:45 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:45.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:45 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:45.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:45 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:45.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:45 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:45.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:45 trial187 ceph-mon[27464]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:45.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:45 trial028 ceph-mon[22984]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:24:45.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:45 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:45.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:45 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:45.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:45 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:45.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:45 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:45.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:45 trial028 ceph-mon[22984]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:45.792 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.793+0000 7f369f7fe6c0 1 -- 10.20.193.187:0/2397642555 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f36a80efd30 con 0x7f36700b5680 2026-02-13T01:24:45.793 INFO:teuthology.orchestra.run.trial187.stdout:Created osd(s) 8 on host 'trial187' 2026-02-13T01:24:45.795 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f36700b5680 msgr2=0x7f36700d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.795 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f36700b5680 0x7f36700d5b30 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3694004750 tx=0x7f3694005f10 comp rx=0 tx=0).stop 2026-02-13T01:24:45.795 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 msgr2=0x7f36a8171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 0x7f36a8171390 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f368c00b6c0 tx=0x7f368c00bb90 comp rx=0 tx=0).stop 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 shutdown_connections 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f36700b5680 0x7f36700d5b30 unknown :-1 s=CLOSED pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f36a8110050 0x7f36a8171390 unknown :-1 s=CLOSED pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f36a8110a00 0x7f36a80f8cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 --2- 10.20.193.187:0/2397642555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36a810eed0 0x7f36a80f8470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 >> 10.20.193.187:0/2397642555 conn(0x7f36a80ec5f0 msgr2=0x7f36a80ee580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 shutdown_connections 2026-02-13T01:24:45.796 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:24:45.796+0000 7f36aca316c0 1 -- 10.20.193.187:0/2397642555 wait complete. 2026-02-13T01:24:45.836 DEBUG:teuthology.orchestra.run.trial187:osd.8> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.8.service 2026-02-13T01:24:45.839 INFO:tasks.cephadm:Deploying osd.9 on trial028 with /dev/vg_nvme/lv_1... 2026-02-13T01:24:45.839 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:24:46.027 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:24:46.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:46.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:46.688 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.688 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.688 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:46 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:46.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:46.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:46 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:46.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:46.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:46.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:46.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:46.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:46.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:46 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:46.913 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:24:46.936 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_1 --skip-validation 2026-02-13T01:24:47.122 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.321+0000 7f9b186b96c0 1 -- 10.20.193.28:0/768018039 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b101193d0 msgr2=0x7f9b10179d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.321+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/768018039 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b101193d0 0x7f9b10179d60 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=13026616518000325709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0c00aa40 tx=0x7f9b0c02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.321+0000 7f9b186b96c0 1 -- 10.20.193.28:0/768018039 shutdown_connections 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/768018039 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b101193d0 0x7f9b10179d60 unknown :-1 s=CLOSED pgs=46 gs=3 cs=0 l=1 c_cookie=13026616518000325709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/768018039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b10118a20 0x7f9b10118e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/768018039 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9b101178a0 0x7f9b10117c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:47.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 -- 10.20.193.28:0/768018039 >> 10.20.193.28:0/768018039 conn(0x7f9b100f4fc0 msgr2=0x7f9b101153d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:47.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 -- 10.20.193.28:0/768018039 shutdown_connections 2026-02-13T01:24:47.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 -- 10.20.193.28:0/768018039 wait complete. 2026-02-13T01:24:47.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 Processor -- start 2026-02-13T01:24:47.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.322+0000 7f9b186b96c0 1 -- start start 2026-02-13T01:24:47.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 0x7f9b10100e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b10118a20 0x7f9b10179d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9b101193d0 0x7f9b101016b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101022e0 con 0x7f9b101178a0 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10102450 con 0x7f9b10118a20 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10102610 con 0x7f9b101193d0 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 0x7f9b10100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 0x7f9b10100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41934/0 (socket says 10.20.193.28:41934) 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 -- 10.20.193.28:0/2120260884 learned_addr learned my addr 10.20.193.28:0/2120260884 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b15c296c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b10118a20 0x7f9b10179d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:47.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b16c2b6c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9b101193d0 0x7f9b101016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 -- 10.20.193.28:0/2120260884 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9b101193d0 msgr2=0x7f9b101016b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9b101193d0 0x7f9b101016b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 -- 10.20.193.28:0/2120260884 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b10118a20 msgr2=0x7f9b10179d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b10118a20 0x7f9b10179d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 -- 10.20.193.28:0/2120260884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c00a660 con 0x7f9b101178a0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b1642a6c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 0x7f9b10100e50 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b00009490 tx=0x7f9b0000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b00004a80 con 0x7f9b101178a0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9b00009030 con 0x7f9b101178a0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.323+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b101028f0 con 0x7f9b101178a0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.324+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b10102e20 con 0x7f9b101178a0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.324+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b000071c0 con 0x7f9b101178a0 2026-02-13T01:24:47.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.324+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1017ddc0 con 0x7f9b101178a0 2026-02-13T01:24:47.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.327+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f9b00004060 con 0x7f9b101178a0 2026-02-13T01:24:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.329+0000 7f9af77fe6c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9aec0b5680 0x7f9aec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.329+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5310+0+0 (secure 0 0 0) 0x7f9b000e3060 con 0x7f9b101178a0 2026-02-13T01:24:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.329+0000 7f9b15c296c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9aec0b5680 0x7f9aec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.329+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9b000e34e0 con 0x7f9b101178a0 2026-02-13T01:24:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.329+0000 7f9b15c296c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9aec0b5680 0x7f9aec0d5b30 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b04004750 tx=0x7f9b04009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:47.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:47.435+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f9b100f8710 con 0x7f9aec0b5680 2026-02-13T01:24:47.534 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.535 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.536 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:47 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.537 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:24:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:24:47.413+0000 7f627b6366c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T01:24:47.537 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:24:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:24:47.421+0000 7f62774fa6c0 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:47.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:47 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:47 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:24:48.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:48.698 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:48 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:48.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:24:48.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T01:24:48.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:48.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:48.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:48.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:48.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:48.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:48.804 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:48 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:48.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:24:48.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='client.14496 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:48.895 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:48 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:49.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:24:49.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:24:49.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] boot 2026-02-13T01:24:49.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: osdmap e52: 9 total, 9 up, 9 in 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"} : dispatch 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"}]': finished 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/50564222' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"} : dispatch 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:49.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2195370160' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:49.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:24:49.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:24:49.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] boot 2026-02-13T01:24:49.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: osdmap e52: 9 total, 9 up, 9 in 2026-02-13T01:24:49.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:49.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"} : dispatch 2026-02-13T01:24:49.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"}]': finished 2026-02-13T01:24:49.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/50564222' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"} : dispatch 2026-02-13T01:24:49.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:24:49.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:49.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2195370160' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:49.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:24:49.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:24:49.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: osd.8 [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] boot 2026-02-13T01:24:49.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: osdmap e52: 9 total, 9 up, 9 in 2026-02-13T01:24:49.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:49.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"} : dispatch 2026-02-13T01:24:49.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"}]': finished 2026-02-13T01:24:49.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/50564222' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "184bf253-88c2-45c2-a17b-e1d06b4b1985"} : dispatch 2026-02-13T01:24:49.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:24:49.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:49.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2195370160' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:51.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:50 trial134 ceph-mon[27948]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:51.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:50 trial134 ceph-mon[27948]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:24:51.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:51.105 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:50 trial028 ceph-mon[22984]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:51.105 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:50 trial028 ceph-mon[22984]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:24:51.105 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:50 trial187 ceph-mon[27464]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:50 trial187 ceph-mon[27464]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:24:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:52.026 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:51 trial028 ceph-mon[22984]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:24:52.027 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:52.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:51 trial134 ceph-mon[27948]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:24:52.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:52.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:51 trial187 ceph-mon[27464]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:24:52.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:52.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:52 trial028 ceph-mon[22984]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:52.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:52 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:52.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:52 trial028 ceph-mon[22984]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:24:52.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:52 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:52.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:52 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:24:52.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:52 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:52 trial134 ceph-mon[27948]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:52 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:52 trial134 ceph-mon[27948]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:24:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:52 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:52 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:24:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:52 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:52 trial187 ceph-mon[27464]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:52 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:52 trial187 ceph-mon[27464]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:24:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:52 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:52 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:24:53.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:52 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:55.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:54 trial134 ceph-mon[27948]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 120 KiB/s, 0 objects/s recovering 2026-02-13T01:24:55.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:54 trial187 ceph-mon[27464]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 120 KiB/s, 0 objects/s recovering 2026-02-13T01:24:55.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:54 trial028 ceph-mon[22984]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 120 KiB/s, 0 objects/s recovering 2026-02-13T01:24:56.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:56 trial028 ceph-mon[22984]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 97 KiB/s, 0 objects/s recovering 2026-02-13T01:24:56.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:56.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:56.845 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:56 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:56 trial134 ceph-mon[27948]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 97 KiB/s, 0 objects/s recovering 2026-02-13T01:24:57.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:57.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:56 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:56 trial187 ceph-mon[27464]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 97 KiB/s, 0 objects/s recovering 2026-02-13T01:24:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:56 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.325+0000 7f9b17eb46c0 1 -- 10.20.193.28:0/2120260884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f9ae8003570 con 0x7f9b101178a0 2026-02-13T01:24:57.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.325+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mon.0 v2:10.20.193.28:3300/0 7 ==== osd_map(51..56 src has 1..56) ==== 3239+0+0 (secure 0 0 0) 0x7f9b000aa930 con 0x7f9b101178a0 2026-02-13T01:24:57.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.573+0000 7f9af77fe6c0 1 -- 10.20.193.28:0/2120260884 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f9b100f8710 con 0x7f9aec0b5680 2026-02-13T01:24:57.574 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 9 on host 'trial028' 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9aec0b5680 msgr2=0x7f9aec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9aec0b5680 0x7f9aec0d5b30 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b04004750 tx=0x7f9b04009260 comp rx=0 tx=0).stop 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 msgr2=0x7f9b10100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 0x7f9b10100e50 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b00009490 tx=0x7f9b0000bca0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 shutdown_connections 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9aec0b5680 0x7f9aec0d5b30 unknown :-1 s=CLOSED pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9b101193d0 0x7f9b101016b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9b10118a20 0x7f9b10179d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 --2- 10.20.193.28:0/2120260884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b101178a0 0x7f9b10100e50 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 >> 10.20.193.28:0/2120260884 conn(0x7f9b100f4fc0 msgr2=0x7f9b100f6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:57.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.576+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 shutdown_connections 2026-02-13T01:24:57.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:24:57.577+0000 7f9b186b96c0 1 -- 10.20.193.28:0/2120260884 wait complete. 2026-02-13T01:24:57.685 DEBUG:teuthology.orchestra.run.trial028:osd.9> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.9.service 2026-02-13T01:24:57.689 INFO:tasks.cephadm:Deploying osd.10 on trial134 with /dev/vg_nvme/lv_1... 2026-02-13T01:24:57.690 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:24:57.811 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:24:57.966 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:24:57.966 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.966 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.966 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.966 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:57.967 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.967 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:57.967 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:57.967 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.967 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.967 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:57 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.984 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:57.985 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:57 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:24:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:58.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:58.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:58.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:58.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:58.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:58.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:57 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:58.229 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-13T01:24:58.246 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial134:vg_nvme/lv_1 --skip-validation 2026-02-13T01:24:58.364 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.b/config 2026-02-13T01:24:58.486 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2070109408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110a00 msgr2=0x7f9c18171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:58.486 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2070109408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110a00 0x7f9c18171390 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=501234225092511807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c0c00aa40 tx=0x7f9c0c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:58.486 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2070109408 shutdown_connections 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2070109408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110a00 0x7f9c18171390 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=501234225092511807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2070109408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c18110050 0x7f9c181104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2070109408 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9c1810eed0 0x7f9c1810f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2070109408 >> 10.20.193.134:0/2070109408 conn(0x7f9c180ec5f0 msgr2=0x7f9c1810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2070109408 shutdown_connections 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2070109408 wait complete. 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 Processor -- start 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- start start 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9c1810eed0 0x7f9c180f8480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 0x7f9c18171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:58.487 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c18110a00 0x7f9c180f8cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180f9910 con 0x7f9c18110a00 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180f9a80 con 0x7f9c18110050 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1f7616c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180f9c40 con 0x7f9c1810eed0 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1ccd16c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 0x7f9c18171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1ccd16c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 0x7f9c18171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.134:40186/0 (socket says 10.20.193.134:40186) 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1ccd16c0 1 -- 10.20.193.134:0/2027210674 learned_addr learned my addr 10.20.193.134:0/2027210674 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.486+0000 7f9c1d4d26c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9c1810eed0 0x7f9c180f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1dcd36c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c18110a00 0x7f9c180f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1ccd16c0 1 -- 10.20.193.134:0/2027210674 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9c1810eed0 msgr2=0x7f9c180f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1ccd16c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9c1810eed0 0x7f9c180f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:58.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1ccd16c0 1 -- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c18110a00 msgr2=0x7f9c180f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1ccd16c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c18110a00 0x7f9c180f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1ccd16c0 1 -- 10.20.193.134:0/2027210674 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c00a660 con 0x7f9c18110050 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1ccd16c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 0x7f9c18171370 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c0000b6c0 tx=0x7f9c0000bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c000044a0 con 0x7f9c18110050 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c180f9ec0 con 0x7f9c18110050 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c0000be50 con 0x7f9c18110050 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c0000cdc0 con 0x7f9c18110050 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c180fa420 con 0x7f9c18110050 2026-02-13T01:24:58.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.487+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c18175440 con 0x7f9c18110050 2026-02-13T01:24:58.490 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.488+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f9c000026b0 con 0x7f9c18110050 2026-02-13T01:24:58.490 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.489+0000 7f9c167fc6c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9be00b5600 0x7f9be00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:58.491 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.489+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5742+0+0 (secure 0 0 0) 0x7f9c000e2f30 con 0x7f9c18110050 2026-02-13T01:24:58.491 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.489+0000 7f9c1d4d26c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9be00b5600 0x7f9be00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:58.491 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.489+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9c000a9d00 con 0x7f9c18110050 2026-02-13T01:24:58.491 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.490+0000 7f9c1d4d26c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9be00b5600 0x7f9be00d5ab0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c04004750 tx=0x7f9c04009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:58.587 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:24:58.589+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f9c180efd40 con 0x7f9be00b5600 2026-02-13T01:24:59.080 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T01:24:59.080 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:24:59.080 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:24:59.080 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:59.080 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:59.080 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:59.081 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:58 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:24:59.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:59.088 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:59.088 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:59.088 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:59.088 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:59.088 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:58 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.088 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:24:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:24:58.812+0000 7f5c114666c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T01:24:59.088 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:24:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:24:58.822+0000 7f5c093226c0 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T01:24:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:24:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:24:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]} : dispatch 2026-02-13T01:24:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:59.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:58 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"} : dispatch 2026-02-13T01:25:00.138 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"}]': finished 2026-02-13T01:25:00.139 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/3285163176' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"} : dispatch 2026-02-13T01:25:00.139 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] boot 2026-02-13T01:25:00.139 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:25:00.139 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.139 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:00.139 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:24:59 trial134 ceph-mon[27948]: from='client.? 10.20.193.134:0/1360141869' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:25:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:25:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:25:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T01:25:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"} : dispatch 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"}]': finished 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/3285163176' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"} : dispatch 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] boot 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:00.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:24:59 trial187 ceph-mon[27464]: from='client.? 10.20.193.134:0/1360141869' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial134:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"} : dispatch 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"}]': finished 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/3285163176' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d23958fb-8b6d-4d42-9a41-d55ea62f4328"} : dispatch 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: osd.9 [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] boot 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:00.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:24:59 trial028 ceph-mon[22984]: from='client.? 10.20.193.134:0/1360141869' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:25:01.131 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:25:01.131 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:25:01.131 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:01.132 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:01.133 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:01.133 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:00 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:25:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:25:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:00 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:00 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:25:01.935 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:01 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:25:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:01 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:25:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:01 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:03.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:02 trial134 ceph-mon[27948]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:02 trial134 ceph-mon[27948]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:02 trial134 ceph-mon[27948]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:02 trial187 ceph-mon[27464]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:02 trial187 ceph-mon[27464]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:02 trial187 ceph-mon[27464]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:02 trial028 ceph-mon[22984]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:02 trial028 ceph-mon[22984]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:03.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:02 trial028 ceph-mon[22984]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:04.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:03 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:04.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:03 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:04.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:03 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:05.022 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.024+0000 7f9c167fc6c0 1 -- 10.20.193.134:0/2027210674 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c180efd40 con 0x7f9be00b5600 2026-02-13T01:25:05.023 INFO:teuthology.orchestra.run.trial134.stdout:Created osd(s) 10 on host 'trial134' 2026-02-13T01:25:05.025 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9be00b5600 msgr2=0x7f9be00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9be00b5600 0x7f9be00d5ab0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c04004750 tx=0x7f9c04009390 comp rx=0 tx=0).stop 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 msgr2=0x7f9c18171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 0x7f9c18171370 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c0000b6c0 tx=0x7f9c0000bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 shutdown_connections 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c18110a00 0x7f9c180f8cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9c18110050 0x7f9c18171370 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9be00b5600 0x7f9be00d5ab0 unknown :-1 s=CLOSED pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 --2- 10.20.193.134:0/2027210674 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9c1810eed0 0x7f9c180f8480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 >> 10.20.193.134:0/2027210674 conn(0x7f9c180ec5f0 msgr2=0x7f9c180ee520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 shutdown_connections 2026-02-13T01:25:05.026 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-13T01:25:05.027+0000 7f9c1f7616c0 1 -- 10.20.193.134:0/2027210674 wait complete. 2026-02-13T01:25:05.066 DEBUG:teuthology.orchestra.run.trial134:osd.10> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.10.service 2026-02-13T01:25:05.068 INFO:tasks.cephadm:Deploying osd.11 on trial187 with /dev/vg_nvme/lv_1... 2026-02-13T01:25:05.068 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:25:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:04 trial187 ceph-mon[27464]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:05.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:04 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.185 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:25:05.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:04 trial028 ceph-mon[22984]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:04 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:04 trial134 ceph-mon[27948]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:04 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:05.622 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-13T01:25:05.638 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch daemon add osd trial187:vg_nvme/lv_1 --skip-validation 2026-02-13T01:25:05.757 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:25:05.885 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- 10.20.193.187:0/1341027997 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa49410eec0 msgr2=0x7fa49410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.885 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/1341027997 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa49410eec0 0x7fa49410f2b0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=9709788998450917823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa480009970 tx=0x7fa48002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- 10.20.193.187:0/1341027997 shutdown_connections 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/1341027997 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4941109f0 0x7fa494171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/1341027997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa494110040 0x7fa4941104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/1341027997 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa49410eec0 0x7fa49410f2b0 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=9709788998450917823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- 10.20.193.187:0/1341027997 >> 10.20.193.187:0/1341027997 conn(0x7fa4940ec5c0 msgr2=0x7fa49410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- 10.20.193.187:0/1341027997 shutdown_connections 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- 10.20.193.187:0/1341027997 wait complete. 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 Processor -- start 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- start start 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa49410eec0 0x7fa4940f8650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.886 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa494110040 0x7fa494171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 0x7fa4940f8eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4940f9ae0 con 0x7fa49410eec0 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa4940f9c50 con 0x7fa494110040 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa49a2276c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa4940f9e10 con 0x7fa4941109f0 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa493fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 0x7fa4940f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa493fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 0x7fa4940f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.187:52360/0 (socket says 10.20.193.187:52360) 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.885+0000 7fa493fff6c0 1 -- 10.20.193.187:0/455509456 learned_addr learned my addr 10.20.193.187:0/455509456 (peer_addr_for_me v2:10.20.193.187:0/0) 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa492ffd6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa494110040 0x7fa494171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa4937fe6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa49410eec0 0x7fa4940f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa493fff6c0 1 -- 10.20.193.187:0/455509456 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa494110040 msgr2=0x7fa494171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.887 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa493fff6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa494110040 0x7fa494171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa493fff6c0 1 -- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa49410eec0 msgr2=0x7fa4940f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa493fff6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa49410eec0 0x7fa4940f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa493fff6c0 1 -- 10.20.193.187:0/455509456 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa480009590 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa4937fe6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa49410eec0 0x7fa4940f8650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa493fff6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 0x7fa4940f8eb0 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa488006ea0 tx=0x7fa48800cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa488003a30 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa488005510 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4940fa0f0 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa48800dd70 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4940fa5d0 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.886+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa494175400 con 0x7fa4941109f0 2026-02-13T01:25:05.888 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.887+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fa488003b90 con 0x7fa4941109f0 2026-02-13T01:25:05.889 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.888+0000 7fa490ff96c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa45c0b5680 0x7fa45c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.890 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.888+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6175+0+0 (secure 0 0 0) 0x7fa4880e4380 con 0x7fa4941109f0 2026-02-13T01:25:05.890 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.888+0000 7fa4937fe6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa45c0b5680 0x7fa45c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.890 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.888+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4880a7580 con 0x7fa4941109f0 2026-02-13T01:25:05.890 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.889+0000 7fa4937fe6c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa45c0b5680 0x7fa45c0d5b30 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4800098c0 tx=0x7fa480005cb0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:05.980 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:05.983+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa4940f1410 con 0x7fa45c0b5680 2026-02-13T01:25:06.104 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:25:06.104 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:25:06.104 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.105 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:05 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:06.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:25:06.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:25:06.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:05 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:06.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:05 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:06.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:06.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:06.864 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.865 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:06.866 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"} : dispatch 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"}]': finished 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/470002771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"} : dispatch 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: osdmap e62: 12 total, 10 up, 12 in 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:06.867 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:06 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:07.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:25:06 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:25:06.792+0000 7f44015886c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T01:25:07.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:25:06 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:25:06.799+0000 7f43fd44c6c0 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:25:07.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:07.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:07.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:25:07.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:25:07.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:07.053 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.054 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"} : dispatch 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"}]': finished 2026-02-13T01:25:07.055 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/470002771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"} : dispatch 2026-02-13T01:25:07.056 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: osdmap e62: 12 total, 10 up, 12 in 2026-02-13T01:25:07.056 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:07.056 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:07.056 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:06 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:25:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:25:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial134", "root=default"]}]': finished 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"}]': finished 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/470002771' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "49d3cb86-161d-4c61-af51-58a293ae6948"} : dispatch 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: osdmap e62: 12 total, 10 up, 12 in 2026-02-13T01:25:07.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:07.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:07.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:06 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:08.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: from='client.? 10.20.193.187:0/2650148827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] boot 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:08.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:07 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: from='client.? 10.20.193.187:0/2650148827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] boot 2026-02-13T01:25:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:25:08.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:08.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:07 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial187:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:25:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: from='client.? 10.20.193.187:0/2650148827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:25:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:25:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: osd.10 [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] boot 2026-02-13T01:25:08.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:25:08.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:25:08.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:07 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:09.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:25:09.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:25:09.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:09.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:09.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:09.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:25:09.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:08 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:25:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:08 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:25:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:08 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:10.114 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:25:10.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:09 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:10.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:10.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:10.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:10.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:25:10.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:09 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:25:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:09 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:11.131 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:10 trial187 ceph-mon[27464]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:11.131 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:10 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:11.131 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:10 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:25:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:10 trial028 ceph-mon[22984]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:10 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:10 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:25:11.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:10 trial134 ceph-mon[27948]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:11.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:10 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:11.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:10 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:25:12.062 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:11 trial187 ceph-mon[27464]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:25:12.063 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:11 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:12.063 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:11 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.063 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:11 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.063 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:11 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:12.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:11 trial028 ceph-mon[22984]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:25:12.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:11 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:12.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:11 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:11 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:11 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:12.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:11 trial134 ceph-mon[27948]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:25:12.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:11 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:12.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:11 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:11 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:11 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:12.333 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.335+0000 7fa490ff96c0 1 -- 10.20.193.187:0/455509456 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa4940f1410 con 0x7fa45c0b5680 2026-02-13T01:25:12.333 INFO:teuthology.orchestra.run.trial187.stdout:Created osd(s) 11 on host 'trial187' 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.337+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa45c0b5680 msgr2=0x7fa45c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.337+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa45c0b5680 0x7fa45c0d5b30 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4800098c0 tx=0x7fa480005cb0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.337+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 msgr2=0x7fa4940f8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.337+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 0x7fa4940f8eb0 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa488006ea0 tx=0x7fa48800cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 shutdown_connections 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa45c0b5680 0x7fa45c0d5b30 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4941109f0 0x7fa4940f8eb0 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.336 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa494110040 0x7fa494171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.337 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 --2- 10.20.193.187:0/455509456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa49410eec0 0x7fa4940f8650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.337 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 >> 10.20.193.187:0/455509456 conn(0x7fa4940ec5c0 msgr2=0x7fa4940eeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:12.337 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 shutdown_connections 2026-02-13T01:25:12.337 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:12.338+0000 7fa49a2276c0 1 -- 10.20.193.187:0/455509456 wait complete. 2026-02-13T01:25:12.379 DEBUG:teuthology.orchestra.run.trial187:osd.11> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.11.service 2026-02-13T01:25:12.381 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T01:25:12.381 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:25:12.566 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 -- 10.20.193.28:0/1739521638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010fe70 msgr2=0x7f52f01102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 --2- 10.20.193.28:0/1739521638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010fe70 0x7f52f01102e0 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=12096595911172114763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52e0009970 tx=0x7f52e002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 -- 10.20.193.28:0/1739521638 shutdown_connections 2026-02-13T01:25:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 --2- 10.20.193.28:0/1739521638 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52f0110820 0x7f52f01711b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 --2- 10.20.193.28:0/1739521638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010fe70 0x7f52f01102e0 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=12096595911172114763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 --2- 10.20.193.28:0/1739521638 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52f010ecf0 0x7f52f010f0e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 -- 10.20.193.28:0/1739521638 >> 10.20.193.28:0/1739521638 conn(0x7f52f00ec410 msgr2=0x7f52f010c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 -- 10.20.193.28:0/1739521638 shutdown_connections 2026-02-13T01:25:12.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.760+0000 7f52f49536c0 1 -- 10.20.193.28:0/1739521638 wait complete. 2026-02-13T01:25:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.761+0000 7f52f49536c0 1 Processor -- start 2026-02-13T01:25:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.761+0000 7f52f49536c0 1 -- start start 2026-02-13T01:25:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.761+0000 7f52f49536c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 0x7f52f0100dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.761+0000 7f52f49536c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52f010fe70 0x7f52f0171190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52f49536c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52f0110820 0x7f52f0101610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52f49536c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0102260 con 0x7f52f010ecf0 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52f49536c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52f01023d0 con 0x7f52f0110820 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52f49536c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0102590 con 0x7f52f010fe70 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 0x7f52f0100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52effff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52f0110820 0x7f52f0101610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52eeffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52f010fe70 0x7f52f0171190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 0x7f52f0100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40016/0 (socket says 10.20.193.28:40016) 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 -- 10.20.193.28:0/885068473 learned_addr learned my addr 10.20.193.28:0/885068473 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 -- 10.20.193.28:0/885068473 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52f010fe70 msgr2=0x7f52f0171190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52f010fe70 0x7f52f0171190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 -- 10.20.193.28:0/885068473 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52f0110820 msgr2=0x7f52f0101610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52f0110820 0x7f52f0101610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 -- 10.20.193.28:0/885068473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e0009590 con 0x7f52f010ecf0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.762+0000 7f52ef7fe6c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 0x7f52f0100dd0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52dc005dc0 tx=0x7f52dc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.763+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52dc004250 con 0x7f52f010ecf0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.763+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f52dc009070 con 0x7f52f010ecf0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.763+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52dc00cd20 con 0x7f52f010ecf0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.763+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f0102810 con 0x7f52f010ecf0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.763+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f0102ca0 con 0x7f52f010ecf0 2026-02-13T01:25:12.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.763+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f0175230 con 0x7f52f010ecf0 2026-02-13T01:25:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.765+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f52dc0028c0 con 0x7f52f010ecf0 2026-02-13T01:25:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.767+0000 7f52ecff96c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52c40b5680 0x7f52c40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.767+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6586+0+0 (secure 0 0 0) 0x7f52dc0e3300 con 0x7f52f010ecf0 2026-02-13T01:25:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.768+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f52dc0e3780 con 0x7f52f010ecf0 2026-02-13T01:25:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.768+0000 7f52eeffd6c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52c40b5680 0x7f52c40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.768+0000 7f52eeffd6c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52c40b5680 0x7f52c40d5b30 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52e0005b40 tx=0x7f52e00023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:12.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.870+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f52f01748d0 con 0x7f52f010ecf0 2026-02-13T01:25:12.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.872+0000 7f52ecff96c0 1 -- 10.20.193.28:0/885068473 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f52dc0a6320 con 0x7f52f010ecf0 2026-02-13T01:25:12.873 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:12.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52c40b5680 msgr2=0x7f52c40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52c40b5680 0x7f52c40d5b30 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52e0005b40 tx=0x7f52e00023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 msgr2=0x7f52f0100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 0x7f52f0100dd0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52dc005dc0 tx=0x7f52dc00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 shutdown_connections 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52c40b5680 0x7f52c40d5b30 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52f010fe70 0x7f52f0171190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52f0110820 0x7f52f0101610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 --2- 10.20.193.28:0/885068473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52f010ecf0 0x7f52f0100dd0 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 >> 10.20.193.28:0/885068473 conn(0x7f52f00ec410 msgr2=0x7f52f00561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:12.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.873+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 shutdown_connections 2026-02-13T01:25:12.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:12.874+0000 7f52f49536c0 1 -- 10.20.193.28:0/885068473 wait complete. 2026-02-13T01:25:12.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: pgmap v168: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 192 KiB/s, 0 objects/s recovering 2026-02-13T01:25:12.952 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: pgmap v169: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 195 KiB/s, 0 objects/s recovering 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:12.953 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:12 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.015 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1770945907,"num_in_osds":12,"osd_in_since":1770945906,"num_remapped_pgs":0} 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: pgmap v168: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 192 KiB/s, 0 objects/s recovering 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: pgmap v169: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 195 KiB/s, 0 objects/s recovering 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:13.136 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.137 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.137 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.137 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:12 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: pgmap v168: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 192 KiB/s, 0 objects/s recovering 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: pgmap v169: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 195 KiB/s, 0 objects/s recovering 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:25:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:13.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:13.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:12 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.016 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:25:14.114 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:25:13 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:25:13.881+0000 7f4de451b6c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T01:25:14.114 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:25:13 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:25:13.888+0000 7f4de03df6c0 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/885068473' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.115 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:14.116 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:13 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:14.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/885068473' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:14.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:25:14.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:25:14.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:14.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:25:14.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:14.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:14.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:13 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:14.203 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/885068473' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:25:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:25:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:25:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:14.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:14.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:13 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:14.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/481058012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010b960 msgr2=0x7f823010bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 --2- 10.20.193.28:0/481058012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010b960 0x7f823010bdd0 secure :-1 s=READY pgs=147 gs=2 cs=0 l=1 c_cookie=16902894218913568445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8218009970 tx=0x7f821802ed10 comp rx=0 tx=0).stop 2026-02-13T01:25:14.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/481058012 shutdown_connections 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 --2- 10.20.193.28:0/481058012 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f823010c4c0 0x7f823010c960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 --2- 10.20.193.28:0/481058012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010b960 0x7f823010bdd0 unknown :-1 s=CLOSED pgs=147 gs=2 cs=0 l=1 c_cookie=16902894218913568445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 --2- 10.20.193.28:0/481058012 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82300600a0 0x7f823010b420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.398+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/481058012 >> 10.20.193.28:0/481058012 conn(0x7f82300e9040 msgr2=0x7f8230109470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.399+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/481058012 shutdown_connections 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.399+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/481058012 wait complete. 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.399+0000 7f8235d4f6c0 1 Processor -- start 2026-02-13T01:25:14.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.399+0000 7f8235d4f6c0 1 -- start start 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82300600a0 0x7f82300f47e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f823010b960 0x7f82300f4e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010c4c0 0x7f82300f5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82300f61b0 con 0x7f823010c4c0 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82300f6320 con 0x7f82300600a0 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f82300f64e0 con 0x7f823010b960 2026-02-13T01:25:14.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8227fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f823010b960 0x7f82300f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010c4c0 0x7f82300f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8227fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f823010b960 0x7f82300f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:41360/0 (socket says 10.20.193.28:41360) 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8227fff6c0 1 -- 10.20.193.28:0/1327424561 learned_addr learned my addr 10.20.193.28:0/1327424561 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8234d4d6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82300600a0 0x7f82300f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 -- 10.20.193.28:0/1327424561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f823010b960 msgr2=0x7f82300f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f823010b960 0x7f82300f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 -- 10.20.193.28:0/1327424561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82300600a0 msgr2=0x7f82300f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82300600a0 0x7f82300f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 -- 10.20.193.28:0/1327424561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218009590 con 0x7f823010c4c0 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f823554e6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010c4c0 0x7f82300f5a20 secure :-1 s=READY pgs=148 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f822c006fd0 tx=0x7f822c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f822c003c40 con 0x7f823010c4c0 2026-02-13T01:25:14.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/1327424561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82300f67c0 con 0x7f823010c4c0 2026-02-13T01:25:14.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f822c00a070 con 0x7f823010c4c0 2026-02-13T01:25:14.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f822c00dd90 con 0x7f823010c4c0 2026-02-13T01:25:14.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.400+0000 7f8235d4f6c0 1 -- 10.20.193.28:0/1327424561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82300f6d00 con 0x7f823010c4c0 2026-02-13T01:25:14.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.401+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8230110cb0 con 0x7f823010c4c0 2026-02-13T01:25:14.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.403+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f822c005030 con 0x7f823010c4c0 2026-02-13T01:25:14.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.405+0000 7f8225ffb6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f820c0b5680 0x7f820c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.405+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6624+0+0 (secure 0 0 0) 0x7f822c0e43d0 con 0x7f823010c4c0 2026-02-13T01:25:14.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.405+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f822c0e4850 con 0x7f823010c4c0 2026-02-13T01:25:14.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.405+0000 7f8234d4d6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f820c0b5680 0x7f820c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.406+0000 7f8234d4d6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f820c0b5680 0x7f820c0d5b30 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8220004750 tx=0x7f8220009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.506+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8230110370 con 0x7f823010c4c0 2026-02-13T01:25:14.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.506+0000 7f8225ffb6c0 1 -- 10.20.193.28:0/1327424561 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f822c0a73f0 con 0x7f823010c4c0 2026-02-13T01:25:14.507 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:14.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.506+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f820c0b5680 msgr2=0x7f820c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.506+0000 7f81ff7fe6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f820c0b5680 0x7f820c0d5b30 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8220004750 tx=0x7f8220009260 comp rx=0 tx=0).stop 2026-02-13T01:25:14.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.506+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010c4c0 msgr2=0x7f82300f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.506+0000 7f81ff7fe6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010c4c0 0x7f82300f5a20 secure :-1 s=READY pgs=148 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f822c006fd0 tx=0x7f822c00cc00 comp rx=0 tx=0).stop 2026-02-13T01:25:14.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 shutdown_connections 2026-02-13T01:25:14.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f820c0b5680 0x7f820c0d5b30 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f823010b960 0x7f82300f4e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f823010c4c0 0x7f82300f5a20 unknown :-1 s=CLOSED pgs=148 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 --2- 10.20.193.28:0/1327424561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82300600a0 0x7f82300f47e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 >> 10.20.193.28:0/1327424561 conn(0x7f82300e9040 msgr2=0x7f82300eacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 shutdown_connections 2026-02-13T01:25:14.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:14.507+0000 7f81ff7fe6c0 1 -- 10.20.193.28:0/1327424561 wait complete. 2026-02-13T01:25:14.613 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1770945907,"num_in_osds":12,"osd_in_since":1770945906,"num_remapped_pgs":0} 2026-02-13T01:25:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: pgmap v172: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 153 KiB/s, 0 objects/s recovering 2026-02-13T01:25:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:15.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1327424561' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:15.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:14 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:25:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: pgmap v172: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 153 KiB/s, 0 objects/s recovering 2026-02-13T01:25:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:25:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T01:25:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1327424561' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:15.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:14 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: pgmap v172: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 153 KiB/s, 0 objects/s recovering 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial187", "root=default"]}]': finished 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:15.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1327424561' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:15.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:14 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:25:15.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:25:15.797 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: purged_snaps scrub starts 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: purged_snaps scrub ok 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] boot 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:15.927 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:15 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:15.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/4002421289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810ed00 msgr2=0x7fdd8810f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 --2- 10.20.193.28:0/4002421289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810ed00 0x7fdd8810f0f0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=338345551212334581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd740098a0 tx=0x7fdd7402ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:15.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/4002421289 shutdown_connections 2026-02-13T01:25:15.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 --2- 10.20.193.28:0/4002421289 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdd8810fe80 0x7fdd881102f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 --2- 10.20.193.28:0/4002421289 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdd88110830 0x7fdd881711c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 --2- 10.20.193.28:0/4002421289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810ed00 0x7fdd8810f0f0 unknown :-1 s=CLOSED pgs=149 gs=2 cs=0 l=1 c_cookie=338345551212334581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/4002421289 >> 10.20.193.28:0/4002421289 conn(0x7fdd880ec400 msgr2=0x7fdd8810c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:15.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/4002421289 shutdown_connections 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.989+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/4002421289 wait complete. 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 Processor -- start 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 -- start start 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdd8810ed00 0x7fdd880ee580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 0x7fdd881711c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdd88110830 0x7fdd880eede0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880efa10 con 0x7fdd8810fe80 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880efb80 con 0x7fdd8810ed00 2026-02-13T01:25:15.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd8d38f6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880efd40 con 0x7fdd88110830 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd877fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 0x7fdd881711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd87fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdd8810ed00 0x7fdd880ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd877fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 0x7fdd881711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40052/0 (socket says 10.20.193.28:40052) 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.990+0000 7fdd877fe6c0 1 -- 10.20.193.28:0/3415062976 learned_addr learned my addr 10.20.193.28:0/3415062976 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd877fe6c0 1 -- 10.20.193.28:0/3415062976 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdd88110830 msgr2=0x7fdd880eede0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd877fe6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdd88110830 0x7fdd880eede0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd877fe6c0 1 -- 10.20.193.28:0/3415062976 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdd8810ed00 msgr2=0x7fdd880ee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd877fe6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdd8810ed00 0x7fdd880ee580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd877fe6c0 1 -- 10.20.193.28:0/3415062976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd740094c0 con 0x7fdd8810fe80 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd877fe6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 0x7fdd881711c0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd7800b710 tx=0x7fdd7800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd78004250 con 0x7fdd8810fe80 2026-02-13T01:25:15.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdd78009070 con 0x7fdd8810fe80 2026-02-13T01:25:15.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd7800cd70 con 0x7fdd8810fe80 2026-02-13T01:25:15.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/3415062976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd880f0020 con 0x7fdd8810fe80 2026-02-13T01:25:15.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.991+0000 7fdd8d38f6c0 1 -- 10.20.193.28:0/3415062976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd880f04b0 con 0x7fdd8810fe80 2026-02-13T01:25:15.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.992+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd88175240 con 0x7fdd8810fe80 2026-02-13T01:25:15.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.994+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fdd780028c0 con 0x7fdd8810fe80 2026-02-13T01:25:15.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.996+0000 7fdd857fa6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdd5c0b5680 0x7fdd5c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.996+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7fdd780e3580 con 0x7fdd8810fe80 2026-02-13T01:25:15.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.996+0000 7fdd87fff6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdd5c0b5680 0x7fdd5c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:15.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.996+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdd780e3a00 con 0x7fdd8810fe80 2026-02-13T01:25:15.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:15.996+0000 7fdd87fff6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdd5c0b5680 0x7fdd5c0d5b30 secure :-1 s=READY pgs=141 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd7402f9c0 tx=0x7fdd740023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.097+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdd881102f0 con 0x7fdd8810fe80 2026-02-13T01:25:16.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.098+0000 7fdd857fa6c0 1 -- 10.20.193.28:0/3415062976 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fdd780a6460 con 0x7fdd8810fe80 2026-02-13T01:25:16.098 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:16.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdd5c0b5680 msgr2=0x7fdd5c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdd5c0b5680 0x7fdd5c0d5b30 secure :-1 s=READY pgs=141 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd7402f9c0 tx=0x7fdd740023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 msgr2=0x7fdd881711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 0x7fdd881711c0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd7800b710 tx=0x7fdd7800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 shutdown_connections 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdd5c0b5680 0x7fdd5c0d5b30 unknown :-1 s=CLOSED pgs=141 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdd88110830 0x7fdd880eede0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd8810fe80 0x7fdd881711c0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 --2- 10.20.193.28:0/3415062976 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdd8810ed00 0x7fdd880ee580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 >> 10.20.193.28:0/3415062976 conn(0x7fdd880ec400 msgr2=0x7fdd88063340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 shutdown_connections 2026-02-13T01:25:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.099+0000 7fdd5affd6c0 1 -- 10.20.193.28:0/3415062976 wait complete. 2026-02-13T01:25:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: purged_snaps scrub starts 2026-02-13T01:25:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: purged_snaps scrub ok 2026-02-13T01:25:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:16.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] boot 2026-02-13T01:25:16.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:25:16.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:16.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:15 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:16.204 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1770945914,"num_in_osds":12,"osd_in_since":1770945906,"num_remapped_pgs":0} 2026-02-13T01:25:16.205 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: purged_snaps scrub starts 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: purged_snaps scrub ok 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: osd.11 [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] boot 2026-02-13T01:25:16.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:25:16.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:25:16.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:15 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:16.388 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:16.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 -- 10.20.193.28:0/3807932260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc10fbf0 msgr2=0x7f6dbc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/3807932260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc10fbf0 0x7f6dbc114c30 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=13081156651433524693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6db00099a0 tx=0x7f6db002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 -- 10.20.193.28:0/3807932260 shutdown_connections 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/3807932260 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6dbc115410 0x7f6dbc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/3807932260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc10fbf0 0x7f6dbc114c30 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=13081156651433524693 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/3807932260 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 0x7f6dbc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 -- 10.20.193.28:0/3807932260 >> 10.20.193.28:0/3807932260 conn(0x7f6dbc0ecb00 msgr2=0x7f6dbc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 -- 10.20.193.28:0/3807932260 shutdown_connections 2026-02-13T01:25:16.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.585+0000 7f6dc43336c0 1 -- 10.20.193.28:0/3807932260 wait complete. 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 Processor -- start 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 -- start start 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 0x7f6dbc0f4b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6dbc115410 0x7f6dbc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc0f5160 0x7f6dbc0fa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc0f57c0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc0fa970 con 0x7f6dbc115410 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc43336c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc0fab30 con 0x7f6dbc10f200 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc20a46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 0x7f6dbc0f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.586+0000 7f6dc28a56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc0f5160 0x7f6dbc0fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc20a46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 0x7f6dbc0f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:47896/0 (socket says 10.20.193.28:47896) 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc20a46c0 1 -- 10.20.193.28:0/1889960001 learned_addr learned my addr 10.20.193.28:0/1889960001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc18a36c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6dbc115410 0x7f6dbc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc28a56c0 1 -- 10.20.193.28:0/1889960001 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 msgr2=0x7f6dbc0f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc28a56c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 0x7f6dbc0f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc28a56c0 1 -- 10.20.193.28:0/1889960001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6dbc115410 msgr2=0x7f6dbc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc28a56c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6dbc115410 0x7f6dbc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc28a56c0 1 -- 10.20.193.28:0/1889960001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db0009590 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc28a56c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc0f5160 0x7f6dbc0fa430 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6db800c6c0 tx=0x7f6db800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6db80054a0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6db800a030 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6db800dcb0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dbc0fadb0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.587+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dbc0fb240 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.588+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dbc1104d0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.590+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f6db8003810 con 0x7f6dbc0f5160 2026-02-13T01:25:16.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.592+0000 7f6da37fe6c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6d980b5680 0x7f6d980d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.592+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7f6db80e43f0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.592+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6db80e48e0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.592+0000 7f6dc20a46c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6d980b5680 0x7f6d980d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.592+0000 7f6dc20a46c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6d980b5680 0x7f6d980d5b30 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dac009240 tx=0x7f6dac009420 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:16.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.693+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dbc10f5d0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.694+0000 7f6da37fe6c0 1 -- 10.20.193.28:0/1889960001 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18177 (secure 0 0 0) 0x7f6db80a73a0 con 0x7f6dbc0f5160 2026-02-13T01:25:16.694 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:16.694 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":71,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","created":"2026-02-13T01:22:41.806447+0000","modified":"2026-02-13T01:25:15.880005+0000","last_up_change":"2026-02-13T01:25:14.875697+0000","last_in_change":"2026-02-13T01:25:06.785151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:58.205191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b609cc73-d28a-4ba8-9724-13ee6cc98de8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6803","nonce":2961143377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6805","nonce":2961143377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6809","nonce":2961143377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6807","nonce":2961143377}]},"public_addr":"10.20.193.28:6803/2961143377","cluster_addr":"10.20.193.28:6805/2961143377","heartbeat_back_addr":"10.20.193.28:6809/2961143377","heartbeat_front_addr":"10.20.193.28:6807/2961143377","state":["exists","up"]},{"osd":1,"uuid":"8b21607c-6340-49b2-ae85-eb92729919c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6800","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6801","nonce":2922978638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6802","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6803","nonce":2922978638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6806","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6807","nonce":2922978638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6804","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6805","nonce":2922978638}]},"public_addr":"10.20.193.134:6801/2922978638","cluster_addr":"10.20.193.134:6803/2922978638","heartbeat_back_addr":"10.20.193.134:6807/2922978638","heartbeat_front_addr":"10.20.193.134:6805/2922978638","state":["exists","up"]},{"osd":2,"uuid":"6f3ebd5b-92a4-4b56-b83b-1ef57483f823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6800","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6801","nonce":28326527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6802","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6803","nonce":28326527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6806","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6807","nonce":28326527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6804","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6805","nonce":28326527}]},"public_addr":"10.20.193.187:6801/28326527","cluster_addr":"10.20.193.187:6803/28326527","heartbeat_back_addr":"10.20.193.187:6807/28326527","heartbeat_front_addr":"10.20.193.187:6805/28326527","state":["exists","up"]},{"osd":3,"uuid":"f8c87696-e524-441f-b262-8f1b1b088b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6811","nonce":3039326126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6813","nonce":3039326126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6817","nonce":3039326126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6815","nonce":3039326126}]},"public_addr":"10.20.193.28:6811/3039326126","cluster_addr":"10.20.193.28:6813/3039326126","heartbeat_back_addr":"10.20.193.28:6817/3039326126","heartbeat_front_addr":"10.20.193.28:6815/3039326126","state":["exists","up"]},{"osd":4,"uuid":"181c4948-a9b0-4bf5-bb9a-5071865e44ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6808","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6809","nonce":2852482005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6810","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6811","nonce":2852482005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6814","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6815","nonce":2852482005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6812","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6813","nonce":2852482005}]},"public_addr":"10.20.193.134:6809/2852482005","cluster_addr":"10.20.193.134:6811/2852482005","heartbeat_back_addr":"10.20.193.134:6815/2852482005","heartbeat_front_addr":"10.20.193.134:6813/2852482005","state":["exists","up"]},{"osd":5,"uuid":"05fa2cf3-9b55-4589-9db7-f7f20c478be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6808","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6809","nonce":3424321792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6810","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6811","nonce":3424321792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6814","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6815","nonce":3424321792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6812","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6813","nonce":3424321792}]},"public_addr":"10.20.193.187:6809/3424321792","cluster_addr":"10.20.193.187:6811/3424321792","heartbeat_back_addr":"10.20.193.187:6815/3424321792","heartbeat_front_addr":"10.20.193.187:6813/3424321792","state":["exists","up"]},{"osd":6,"uuid":"7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6819","nonce":2743891845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6821","nonce":2743891845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6825","nonce":2743891845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6823","nonce":2743891845}]},"public_addr":"10.20.193.28:6819/2743891845","cluster_addr":"10.20.193.28:6821/2743891845","heartbeat_back_addr":"10.20.193.28:6825/2743891845","heartbeat_front_addr":"10.20.193.28:6823/2743891845","state":["exists","up"]},{"osd":7,"uuid":"83f5f6ed-fa57-4628-bcf0-49d51edea60d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6816","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6817","nonce":55376257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6818","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6819","nonce":55376257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6822","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6823","nonce":55376257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6820","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6821","nonce":55376257}]},"public_addr":"10.20.193.134:6817/55376257","cluster_addr":"10.20.193.134:6819/55376257","heartbeat_back_addr":"10.20.193.134:6823/55376257","heartbeat_front_addr":"10.20.193.134:6821/55376257","state":["exists","up"]},{"osd":8,"uuid":"63963560-6c24-4627-aade-6d99ec304b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6816","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6817","nonce":2802029994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6818","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6819","nonce":2802029994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6822","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6823","nonce":2802029994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6820","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6821","nonce":2802029994}]},"public_addr":"10.20.193.187:6817/2802029994","cluster_addr":"10.20.193.187:6819/2802029994","heartbeat_back_addr":"10.20.193.187:6823/2802029994","heartbeat_front_addr":"10.20.193.187:6821/2802029994","state":["exists","up"]},{"osd":9,"uuid":"184bf253-88c2-45c2-a17b-e1d06b4b1985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6827","nonce":1895700373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6829","nonce":1895700373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6833","nonce":1895700373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6831","nonce":1895700373}]},"public_addr":"10.20.193.28:6827/1895700373","cluster_addr":"10.20.193.28:6829/1895700373","heartbeat_back_addr":"10.20.193.28:6833/1895700373","heartbeat_front_addr":"10.20.193.28:6831/1895700373","state":["exists","up"]},{"osd":10,"uuid":"d23958fb-8b6d-4d42-9a41-d55ea62f4328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6824","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6825","nonce":1465401365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6826","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6827","nonce":1465401365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6830","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6831","nonce":1465401365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6828","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6829","nonce":1465401365}]},"public_addr":"10.20.193.134:6825/1465401365","cluster_addr":"10.20.193.134:6827/1465401365","heartbeat_back_addr":"10.20.193.134:6831/1465401365","heartbeat_front_addr":"10.20.193.134:6829/1465401365","state":["exists","up"]},{"osd":11,"uuid":"49d3cb86-161d-4c61-af51-58a293ae6948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6824","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6825","nonce":3880817278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6826","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6827","nonce":3880817278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6830","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6831","nonce":3880817278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6828","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6829","nonce":3880817278}]},"public_addr":"10.20.193.187:6825/3880817278","cluster_addr":"10.20.193.187:6827/3880817278","heartbeat_back_addr":"10.20.193.187:6831/3880817278","heartbeat_front_addr":"10.20.193.187:6829/3880817278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.844101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:48.399902+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.304413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:06.142985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:13.695054+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:20.759285+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.814864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:39.345155+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.698150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:58.098934+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:05.932878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:13.217409+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/2396565153":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/2466054030":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/4240498935":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6801/4264511310":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6800/4264511310":"2026-02-14T01:22:50.011933+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6d980b5680 msgr2=0x7f6d980d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6d980b5680 0x7f6d980d5b30 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dac009240 tx=0x7f6dac009420 comp rx=0 tx=0).stop 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc0f5160 msgr2=0x7f6dbc0fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc0f5160 0x7f6dbc0fa430 secure :-1 s=READY pgs=152 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6db800c6c0 tx=0x7f6db800cb90 comp rx=0 tx=0).stop 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 shutdown_connections 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc0f5160 0x7f6dbc0fa430 unknown :-1 s=CLOSED pgs=152 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6dbc115410 0x7f6dbc175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6d980b5680 0x7f6d980d5b30 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 --2- 10.20.193.28:0/1889960001 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6dbc10f200 0x7f6dbc0f4b30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 >> 10.20.193.28:0/1889960001 conn(0x7f6dbc0ecb00 msgr2=0x7f6dbc10d800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 shutdown_connections 2026-02-13T01:25:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:16.695+0000 7f6dc43336c0 1 -- 10.20.193.28:0/1889960001 wait complete. 2026-02-13T01:25:16.800 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T01:23:58.205191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T01:25:16.800 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T01:25:16.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:16 trial028 ceph-mon[22984]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:25:16.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:16 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3415062976' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:16.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:16 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1889960001' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:16.985 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:16 trial187 ceph-mon[27464]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:25:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:16 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3415062976' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:16 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1889960001' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:17.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 -- 10.20.193.28:0/2608543584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8010fa50 msgr2=0x7f4f80114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 --2- 10.20.193.28:0/2608543584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8010fa50 0x7f4f80114a90 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=14158611767256058792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f6c0099a0 tx=0x7f4f6c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 -- 10.20.193.28:0/2608543584 shutdown_connections 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 --2- 10.20.193.28:0/2608543584 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4f80115270 0x7f4f80175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 --2- 10.20.193.28:0/2608543584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8010fa50 0x7f4f80114a90 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=14158611767256058792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 --2- 10.20.193.28:0/2608543584 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4f8010f060 0x7f4f8010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 -- 10.20.193.28:0/2608543584 >> 10.20.193.28:0/2608543584 conn(0x7f4f800ec980 msgr2=0x7f4f8010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 -- 10.20.193.28:0/2608543584 shutdown_connections 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.175+0000 7f4f876346c0 1 -- 10.20.193.28:0/2608543584 wait complete. 2026-02-13T01:25:17.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 Processor -- start 2026-02-13T01:25:17.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 -- start start 2026-02-13T01:25:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4f8010f060 0x7f4f8005cbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4f80115270 0x7f4f80175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 0x7f4f8005d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80103290 con 0x7f4f8005d100 2026-02-13T01:25:17.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80103400 con 0x7f4f8010f060 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f876346c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4f801035c0 con 0x7f4f80115270 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 0x7f4f8005d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 0x7f4f8005d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44364/0 (socket says 10.20.193.28:44364) 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 -- 10.20.193.28:0/121288108 learned_addr learned my addr 10.20.193.28:0/121288108 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f866326c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4f8010f060 0x7f4f8005cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f85e316c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4f80115270 0x7f4f80175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 -- 10.20.193.28:0/121288108 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4f80115270 msgr2=0x7f4f80175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4f80115270 0x7f4f80175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 -- 10.20.193.28:0/121288108 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4f8010f060 msgr2=0x7f4f8005cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4f8010f060 0x7f4f8005cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.176+0000 7f4f86e336c0 1 -- 10.20.193.28:0/121288108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c009590 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f86e336c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 0x7f4f8005d5a0 secure :-1 s=READY pgs=154 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f74006ea0 tx=0x7f4f7400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f74003c40 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4f74003da0 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f740081c0 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f801038a0 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f80103d30 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.177+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f80110330 con 0x7f4f8005d100 2026-02-13T01:25:17.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.180+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f4f7400d590 con 0x7f4f8005d100 2026-02-13T01:25:17.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.182+0000 7f4f6b7fe6c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4f5c0b5680 0x7f4f5c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.182+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7f4f740e4600 con 0x7f4f8005d100 2026-02-13T01:25:17.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.182+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4f740e4a80 con 0x7f4f8005d100 2026-02-13T01:25:17.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.182+0000 7f4f866326c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4f5c0b5680 0x7f4f5c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.182+0000 7f4f866326c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4f5c0b5680 0x7f4f5c0d5b30 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f78004750 tx=0x7f4f78009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.283+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f8010fa50 con 0x7f4f8005d100 2026-02-13T01:25:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.284+0000 7f4f6b7fe6c0 1 -- 10.20.193.28:0/121288108 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f4f740a74e0 con 0x7f4f8005d100 2026-02-13T01:25:17.284 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.285+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4f5c0b5680 msgr2=0x7f4f5c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.285+0000 7f4f876346c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4f5c0b5680 0x7f4f5c0d5b30 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f78004750 tx=0x7f4f78009260 comp rx=0 tx=0).stop 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.285+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 msgr2=0x7f4f8005d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.285+0000 7f4f876346c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 0x7f4f8005d5a0 secure :-1 s=READY pgs=154 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f74006ea0 tx=0x7f4f7400ce50 comp rx=0 tx=0).stop 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 shutdown_connections 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4f5c0b5680 0x7f4f5c0d5b30 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4f80115270 0x7f4f80175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f8005d100 0x7f4f8005d5a0 unknown :-1 s=CLOSED pgs=154 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 --2- 10.20.193.28:0/121288108 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4f8010f060 0x7f4f8005cbc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 >> 10.20.193.28:0/121288108 conn(0x7f4f800ec980 msgr2=0x7f4f8010d780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 shutdown_connections 2026-02-13T01:25:17.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:17.286+0000 7f4f876346c0 1 -- 10.20.193.28:0/121288108 wait complete. 2026-02-13T01:25:17.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:16 trial134 ceph-mon[27948]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:25:17.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:16 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3415062976' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:25:17.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:16 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1889960001' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:17.388 INFO:tasks.cephadm:Adding mds.a on trial028 2026-02-13T01:25:17.388 INFO:tasks.cephadm:Adding mds.d on trial028 2026-02-13T01:25:17.388 INFO:tasks.cephadm:Adding mds.g on trial028 2026-02-13T01:25:17.388 INFO:tasks.cephadm:Adding mds.j on trial028 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.b on trial134 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.e on trial134 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.h on trial134 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.k on trial134 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.c on trial187 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.f on trial187 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.i on trial187 2026-02-13T01:25:17.389 INFO:tasks.cephadm:Adding mds.l on trial187 2026-02-13T01:25:17.389 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph orch apply mds all '12;trial028=a;trial028=d;trial028=g;trial028=j;trial134=b;trial134=e;trial134=h;trial134=k;trial187=c;trial187=f;trial187=i;trial187=l' 2026-02-13T01:25:17.508 INFO:teuthology.orchestra.run.trial187.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:25:17.634 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- 10.20.193.187:0/2607002169 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec1109f0 msgr2=0x7faaec171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.634 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/2607002169 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec1109f0 0x7faaec171380 secure :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=458743493361788175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faadc00aa40 tx=0x7faadc02fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.634 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- 10.20.193.187:0/2607002169 shutdown_connections 2026-02-13T01:25:17.634 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/2607002169 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec1109f0 0x7faaec171380 unknown :-1 s=CLOSED pgs=63 gs=1 cs=0 l=1 c_cookie=458743493361788175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.634 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/2607002169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec110040 0x7faaec1104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/2607002169 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 0x7faaec10f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- 10.20.193.187:0/2607002169 >> 10.20.193.187:0/2607002169 conn(0x7faaec0ec5c0 msgr2=0x7faaec10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- 10.20.193.187:0/2607002169 shutdown_connections 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- 10.20.193.187:0/2607002169 wait complete. 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 Processor -- start 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- start start 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 0x7faaec0f8f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 0x7faaec171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec1109f0 0x7faaec0f97b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faaec0fa3e0 con 0x7faaec1109f0 2026-02-13T01:25:17.635 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7faaec0fa550 con 0x7faaec10eec0 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaf0e716c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7faaec0fa710 con 0x7faaec110040 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 0x7faaec171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 0x7faaec171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.187:58722/0 (socket says 10.20.193.187:58722) 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 -- 10.20.193.187:0/3395511408 learned_addr learned my addr 10.20.193.187:0/3395511408 (peer_addr_for_me v2:10.20.193.187:0/0) 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaead766c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec1109f0 0x7faaec0f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaea5756c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 0x7faaec0f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 -- 10.20.193.187:0/3395511408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 msgr2=0x7faaec0f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 0x7faaec0f8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 -- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec1109f0 msgr2=0x7faaec0f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec1109f0 0x7faaec0f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 -- 10.20.193.187:0/3395511408 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc00a660 con 0x7faaec110040 2026-02-13T01:25:17.636 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaea5756c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 0x7faaec0f8f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faaead766c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec1109f0 0x7faaec0f97b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae9d746c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 0x7faaec171380 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000b6c0 tx=0x7faad000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.634+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad00044a0 con 0x7faaec110040 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.635+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faad0009030 con 0x7faaec110040 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.635+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad000ccb0 con 0x7faaec110040 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.635+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec0fa9f0 con 0x7faaec110040 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.635+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec0fae80 con 0x7faaec110040 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.635+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec175390 con 0x7faaec110040 2026-02-13T01:25:17.637 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.636+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7faad0005080 con 0x7faaec110040 2026-02-13T01:25:17.638 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.637+0000 7faae37fe6c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab40b5680 0x7faab40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.638 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.637+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7faad00e3500 con 0x7faaec110040 2026-02-13T01:25:17.638 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.637+0000 7faaea5756c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab40b5680 0x7faab40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.639 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.637+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faad00a6470 con 0x7faaec110040 2026-02-13T01:25:17.639 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.638+0000 7faaea5756c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab40b5680 0x7faab40d5b30 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad8004750 tx=0x7faad8005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.732 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.735+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial134=b;trial134=e;trial134=h;trial134=k;trial187=c;trial187=f;trial187=i;trial187=l", "target": ["mon-mgr", ""]}) -- 0x7faaec0efbd0 con 0x7faab40b5680 2026-02-13T01:25:17.737 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.739+0000 7faae37fe6c0 1 -- 10.20.193.187:0/3395511408 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7faaec0efbd0 con 0x7faab40b5680 2026-02-13T01:25:17.737 INFO:teuthology.orchestra.run.trial187.stdout:Scheduled mds.all update... 2026-02-13T01:25:17.739 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab40b5680 msgr2=0x7faab40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.739 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab40b5680 0x7faab40d5b30 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad8004750 tx=0x7faad8005f10 comp rx=0 tx=0).stop 2026-02-13T01:25:17.739 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 msgr2=0x7faaec171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.739 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 0x7faaec171380 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000b6c0 tx=0x7faad000bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:17.739 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 shutdown_connections 2026-02-13T01:25:17.739 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab40b5680 0x7faab40d5b30 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.740 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faaec110040 0x7faaec171380 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.740 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faaec1109f0 0x7faaec0f97b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.740 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 --2- 10.20.193.187:0/3395511408 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faaec10eec0 0x7faaec0f8f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.740 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 >> 10.20.193.187:0/3395511408 conn(0x7faaec0ec5c0 msgr2=0x7faaec0ef4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.740 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 shutdown_connections 2026-02-13T01:25:17.740 INFO:teuthology.orchestra.run.trial187.stderr:2026-02-13T01:25:17.741+0000 7faaf0e716c0 1 -- 10.20.193.187:0/3395511408 wait complete. 2026-02-13T01:25:17.779 DEBUG:teuthology.orchestra.run.trial028:mds.a> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.a.service 2026-02-13T01:25:17.783 DEBUG:teuthology.orchestra.run.trial028:mds.d> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.d.service 2026-02-13T01:25:17.829 DEBUG:teuthology.orchestra.run.trial028:mds.g> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.g.service 2026-02-13T01:25:17.873 DEBUG:teuthology.orchestra.run.trial028:mds.j> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.j.service 2026-02-13T01:25:17.917 DEBUG:teuthology.orchestra.run.trial134:mds.b> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.b.service 2026-02-13T01:25:17.920 DEBUG:teuthology.orchestra.run.trial134:mds.e> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.e.service 2026-02-13T01:25:17.963 DEBUG:teuthology.orchestra.run.trial134:mds.h> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.h.service 2026-02-13T01:25:18.006 DEBUG:teuthology.orchestra.run.trial134:mds.k> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.k.service 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/121288108' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:18.034 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:18.035 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:18.035 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:17 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:18.049 DEBUG:teuthology.orchestra.run.trial187:mds.c> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.c.service 2026-02-13T01:25:18.051 DEBUG:teuthology.orchestra.run.trial187:mds.f> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.f.service 2026-02-13T01:25:18.095 DEBUG:teuthology.orchestra.run.trial187:mds.i> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.i.service 2026-02-13T01:25:18.139 DEBUG:teuthology.orchestra.run.trial187:mds.l> sudo journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.l.service 2026-02-13T01:25:18.183 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T01:25:18.183 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/121288108' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:18.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:17 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/121288108' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:18.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:17 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:18.365 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:18.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 -- 10.20.193.28:0/705739761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0808115270 msgr2=0x7f0808175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 --2- 10.20.193.28:0/705739761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0808115270 0x7f0808175c10 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=8687319066202996493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f080400a9b0 tx=0x7f080402fd60 comp rx=0 tx=0).stop 2026-02-13T01:25:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 -- 10.20.193.28:0/705739761 shutdown_connections 2026-02-13T01:25:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 --2- 10.20.193.28:0/705739761 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f080810fa50 0x7f0808114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 --2- 10.20.193.28:0/705739761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0808115270 0x7f0808175c10 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=8687319066202996493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 --2- 10.20.193.28:0/705739761 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f080810f060 0x7f080810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.557+0000 7f080e6506c0 1 -- 10.20.193.28:0/705739761 >> 10.20.193.28:0/705739761 conn(0x7f08080ec980 msgr2=0x7f080810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:18.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.558+0000 7f080e6506c0 1 -- 10.20.193.28:0/705739761 shutdown_connections 2026-02-13T01:25:18.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.558+0000 7f080e6506c0 1 -- 10.20.193.28:0/705739761 wait complete. 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 Processor -- start 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 -- start start 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 0x7f080811cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0808115270 0x7f080811d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0808122860 0x7f0808122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0808123270 con 0x7f080810f060 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08081233e0 con 0x7f0808122860 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080e6506c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f08081235a0 con 0x7f0808115270 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080d64e6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 0x7f080811cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080ce4d6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0808115270 0x7f080811d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080d64e6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 0x7f080811cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44376/0 (socket says 10.20.193.28:44376) 2026-02-13T01:25:18.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080d64e6c0 1 -- 10.20.193.28:0/3593559544 learned_addr learned my addr 10.20.193.28:0/3593559544 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:18.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.559+0000 7f080de4f6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0808122860 0x7f0808122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080d64e6c0 1 -- 10.20.193.28:0/3593559544 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0808115270 msgr2=0x7f080811d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080d64e6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0808115270 0x7f080811d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080d64e6c0 1 -- 10.20.193.28:0/3593559544 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0808122860 msgr2=0x7f0808122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080d64e6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0808122860 0x7f0808122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080d64e6c0 1 -- 10.20.193.28:0/3593559544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f8009590 con 0x7f080810f060 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080de4f6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0808122860 0x7f0808122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080d64e6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 0x7f080811cf60 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07f8004750 tx=0x7f07f800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07f8004250 con 0x7f080810f060 2026-02-13T01:25:18.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f07f8009070 con 0x7f080810f060 2026-02-13T01:25:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07f80071c0 con 0x7f080810f060 2026-02-13T01:25:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080400a5b0 con 0x7f080810f060 2026-02-13T01:25:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.560+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0808163d50 con 0x7f080810f060 2026-02-13T01:25:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.561+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0808110330 con 0x7f080810f060 2026-02-13T01:25:18.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.563+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f07f80028c0 con 0x7f080810f060 2026-02-13T01:25:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.565+0000 7f07f67fc6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f07e40b5680 0x7f07e40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.565+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7f07f80e3a20 con 0x7f080810f060 2026-02-13T01:25:18.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.565+0000 7f080ce4d6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f07e40b5680 0x7f07e40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.565+0000 7f080ce4d6c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f07e40b5680 0x7f07e40d5b30 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08081238f0 tx=0x7f07fc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:18.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.566+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f07f80a6900 con 0x7f080810f060 2026-02-13T01:25:18.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.689+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f080810fa50 con 0x7f080810f060 2026-02-13T01:25:18.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.689+0000 7f07f67fc6c0 1 -- 10.20.193.28:0/3593559544 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f07f80a9ab0 con 0x7f080810f060 2026-02-13T01:25:18.690 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:18.690 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":1,"btime":"2026-02-13T01:22:41:806273+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 1 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.690+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f07e40b5680 msgr2=0x7f07e40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.690+0000 7f080e6506c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f07e40b5680 0x7f07e40d5b30 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08081238f0 tx=0x7f07fc009260 comp rx=0 tx=0).stop 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.690+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 msgr2=0x7f080811cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.690+0000 7f080e6506c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 0x7f080811cf60 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07f8004750 tx=0x7f07f800be00 comp rx=0 tx=0).stop 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 shutdown_connections 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f07e40b5680 0x7f07e40d5b30 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0808115270 0x7f080811d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0808122860 0x7f0808122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 --2- 10.20.193.28:0/3593559544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f080810f060 0x7f080811cf60 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 >> 10.20.193.28:0/3593559544 conn(0x7f08080ec980 msgr2=0x7f080810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:18.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 shutdown_connections 2026-02-13T01:25:18.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:18.691+0000 7f080e6506c0 1 -- 10.20.193.28:0/3593559544 wait complete. 2026-02-13T01:25:19.032 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:18 trial187 ceph-mon[27464]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial134=b;trial134=e;trial134=h;trial134=k;trial187=c;trial187=f;trial187=i;trial187=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:19.032 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:18 trial187 ceph-mon[27464]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:19.032 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:18 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:19.032 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:18 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:19.032 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:18 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:19.032 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:18 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3593559544' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:18 trial028 ceph-mon[22984]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial134=b;trial134=e;trial134=h;trial134=k;trial187=c;trial187=f;trial187=i;trial187=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:18 trial028 ceph-mon[22984]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:18 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:18 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:18 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:18 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3593559544' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:18 trial134 ceph-mon[27948]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial134=b;trial134=e;trial134=h;trial134=k;trial187=c;trial187=f;trial187=i;trial187=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:18 trial134 ceph-mon[27948]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:18 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:18 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:18 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:18 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3593559544' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:19.393 INFO:journalctl@ceph.mds.l.trial187.stdout:Feb 13 01:25:19 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-l[56535]: starting mds.l at 2026-02-13T01:25:20.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:20.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.187:6832/60649704,v1:10.20.193.187:6833/60649704] up:boot 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: fsmap 1 up:standby 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:20.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:19 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.187:6832/60649704,v1:10.20.193.187:6833/60649704] up:boot 2026-02-13T01:25:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: fsmap 1 up:standby 2026-02-13T01:25:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:25:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:20.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:20.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:19 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:20.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:20.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.187:6832/60649704,v1:10.20.193.187:6833/60649704] up:boot 2026-02-13T01:25:20.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: fsmap 1 up:standby 2026-02-13T01:25:20.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:19 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:20.303 INFO:journalctl@ceph.mds.k.trial134.stdout:Feb 13 01:25:19 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-k[55267]: starting mds.k at 2026-02-13T01:25:20.792 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:20.982 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:21.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.111 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:21.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:21.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:21.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:21.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.134:6832/1945194409,v1:10.20.193.134:6833/1945194409] up:boot 2026-02-13T01:25:21.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: fsmap 2 up:standby 2026-02-13T01:25:21.112 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:21 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:25:21.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/1451064670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f810f200 msgr2=0x7ff5f810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/1451064670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f810f200 0x7ff5f810f5d0 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=16467564525704700782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5e80099a0 tx=0x7ff5e802ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:21.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/1451064670 shutdown_connections 2026-02-13T01:25:21.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/1451064670 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff5f8115410 0x7ff5f8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/1451064670 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810fbf0 0x7ff5f8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/1451064670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f810f200 0x7ff5f810f5d0 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=16467564525704700782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/1451064670 >> 10.20.193.28:0/1451064670 conn(0x7ff5f80ecb00 msgr2=0x7ff5f810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.240+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/1451064670 shutdown_connections 2026-02-13T01:25:21.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.241+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/1451064670 wait complete. 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.241+0000 7ff5ff4296c0 1 Processor -- start 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.241+0000 7ff5ff4296c0 1 -- start start 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5ff4296c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 0x7ff5f80f90a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5ff4296c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff5f8115410 0x7ff5f8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5ff4296c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f80f96d0 0x7ff5f80fe900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5ff4296c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f80f9dc0 con 0x7ff5f80f96d0 2026-02-13T01:25:21.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5ff4296c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f80fee40 con 0x7ff5f810f200 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5ff4296c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f80ff000 con 0x7ff5f8115410 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5fd19a6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 0x7ff5f80f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5fd19a6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 0x7ff5f80f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:37234/0 (socket says 10.20.193.28:37234) 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5fd19a6c0 1 -- 10.20.193.28:0/2602626302 learned_addr learned my addr 10.20.193.28:0/2602626302 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5fc9996c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff5f8115410 0x7ff5f8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.242+0000 7ff5fd99b6c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f80f96d0 0x7ff5f80fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5fd19a6c0 1 -- 10.20.193.28:0/2602626302 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff5f8115410 msgr2=0x7ff5f8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5fd19a6c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff5f8115410 0x7ff5f8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5fd19a6c0 1 -- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f80f96d0 msgr2=0x7ff5f80fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5fd19a6c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f80f96d0 0x7ff5f80fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5fd19a6c0 1 -- 10.20.193.28:0/2602626302 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e8009590 con 0x7ff5f810f200 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5fd19a6c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 0x7ff5f80f90a0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5e80098c0 tx=0x7ff5e802fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5e8002ae0 con 0x7ff5f810f200 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff5e8007740 con 0x7ff5f810f200 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f80ff280 con 0x7ff5f810f200 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.243+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5e8037520 con 0x7ff5f810f200 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.244+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f80ff700 con 0x7ff5f810f200 2026-02-13T01:25:21.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.244+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f81104d0 con 0x7ff5f810f200 2026-02-13T01:25:21.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.246+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7ff5e8002c40 con 0x7ff5f810f200 2026-02-13T01:25:21.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.248+0000 7ff5e67fc6c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff5d40b5600 0x7ff5d40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.248+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7ff5e81076e0 con 0x7ff5f810f200 2026-02-13T01:25:21.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.248+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff5e8107b60 con 0x7ff5f810f200 2026-02-13T01:25:21.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.248+0000 7ff5fc9996c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff5d40b5600 0x7ff5d40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.249+0000 7ff5fc9996c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff5d40b5600 0x7ff5d40d5ab0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5f80ff990 tx=0x7ff5ec009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.134:6832/1945194409,v1:10.20.193.134:6833/1945194409] up:boot 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: fsmap 2 up:standby 2026-02-13T01:25:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:21 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:25:21.371 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 13 01:25:21 trial028 systemd[1]: Started Ceph mds.j for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:25:21.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.374+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5f810f5d0 con 0x7ff5f810f200 2026-02-13T01:25:21.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.375+0000 7ff5e67fc6c0 1 -- 10.20.193.28:0/2602626302 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7ff5e80ca5c0 con 0x7ff5f810f200 2026-02-13T01:25:21.376 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:21.376 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":3,"btime":"2026-02-13T01:25:20:891516+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6833/1945194409","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6832","nonce":1945194409},{"type":"v1","addr":"10.20.193.134:6833","nonce":1945194409}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24523,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6833/60649704","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6832","nonce":60649704},{"type":"v1","addr":"10.20.193.187:6833","nonce":60649704}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2026-02-13T01:25:21.376 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 3 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff5d40b5600 msgr2=0x7ff5d40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff5d40b5600 0x7ff5d40d5ab0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5f80ff990 tx=0x7ff5ec009260 comp rx=0 tx=0).stop 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 msgr2=0x7ff5f80f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 0x7ff5f80f90a0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5e80098c0 tx=0x7ff5e802fc60 comp rx=0 tx=0).stop 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 shutdown_connections 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff5d40b5600 0x7ff5d40d5ab0 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff5f8115410 0x7ff5f8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff5f80f96d0 0x7ff5f80fe900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 --2- 10.20.193.28:0/2602626302 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff5f810f200 0x7ff5f80f90a0 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 >> 10.20.193.28:0/2602626302 conn(0x7ff5f80ecb00 msgr2=0x7ff5f8113040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 shutdown_connections 2026-02-13T01:25:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:21.378+0000 7ff5ff4296c0 1 -- 10.20.193.28:0/2602626302 wait complete. 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:21.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.134:6832/1945194409,v1:10.20.193.134:6833/1945194409] up:boot 2026-02-13T01:25:21.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: fsmap 2 up:standby 2026-02-13T01:25:21.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:21 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:25:21.696 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 13 01:25:21 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-j[56008]: starting mds.j at 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2602626302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:22.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:22 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:22.325 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2602626302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:22.325 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:22.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:22.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:22 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:22.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2602626302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:22.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:22.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:22.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:22.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:22 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:22.696 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 systemd[1]: Starting Ceph mds.d for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:25:23.012 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 podman[56286]: 2026-02-13 01:25:22.723186379 +0000 UTC m=+0.029044764 container create fa2e300bf68151e53064502ca0a1e64663697a43961d8a0cbd44fc0aa8c6fe4b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-d, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, version=10, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:25:23.012 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 podman[56286]: 2026-02-13 01:25:22.762502744 +0000 UTC m=+0.068361079 container init fa2e300bf68151e53064502ca0a1e64663697a43961d8a0cbd44fc0aa8c6fe4b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-d, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, ceph=True, version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause) 2026-02-13T01:25:23.012 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 podman[56286]: 2026-02-13 01:25:22.767526752 +0000 UTC m=+0.073385077 container start fa2e300bf68151e53064502ca0a1e64663697a43961d8a0cbd44fc0aa8c6fe4b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-d, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, ceph=True, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:25:23.012 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 bash[56286]: fa2e300bf68151e53064502ca0a1e64663697a43961d8a0cbd44fc0aa8c6fe4b 2026-02-13T01:25:23.013 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 podman[56286]: 2026-02-13 01:25:22.71198354 +0000 UTC m=+0.017841885 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:25:23.013 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 systemd[1]: Started Ceph mds.d for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:25:23.013 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:25:22 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-d[56301]: starting mds.d at 2026-02-13T01:25:23.270 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.28:6834/1374905070,v1:10.20.193.28:6835/1374905070] up:boot 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: fsmap 3 up:standby 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:23.271 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:23.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.28:6834/1374905070,v1:10.20.193.28:6835/1374905070] up:boot 2026-02-13T01:25:23.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: fsmap 3 up:standby 2026-02-13T01:25:23.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:23.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:23 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.28:6834/1374905070,v1:10.20.193.28:6835/1374905070] up:boot 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: fsmap 3 up:standby 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:23.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:23.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:23.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:23 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:23.484 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:23.625 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 podman[55567]: 2026-02-13 01:25:23.592780845 +0000 UTC m=+0.016086383 container create e133be779f690dd4b7b85bb21b072d988f623055f329f2d24e8d6f70f01d1701 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-e, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, version=10, license=BSD-3-Clause, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:25:23.674 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 -- 10.20.193.28:0/4185594370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 msgr2=0x7efcdc175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 --2- 10.20.193.28:0/4185594370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc175c10 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=372047386081048114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd800aa70 tx=0x7efcd802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 -- 10.20.193.28:0/4185594370 shutdown_connections 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 --2- 10.20.193.28:0/4185594370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc175c10 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=372047386081048114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 --2- 10.20.193.28:0/4185594370 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10fa50 0x7efcdc114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 --2- 10.20.193.28:0/4185594370 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efcdc10f060 0x7efcdc10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 -- 10.20.193.28:0/4185594370 >> 10.20.193.28:0/4185594370 conn(0x7efcdc0ec980 msgr2=0x7efcdc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 -- 10.20.193.28:0/4185594370 shutdown_connections 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 -- 10.20.193.28:0/4185594370 wait complete. 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.867+0000 7efce31576c0 1 Processor -- start 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 -- start start 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10f060 0x7efcdc11cf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc11d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efcdc122890 0x7efcdc122d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc1232a0 con 0x7efcdc115270 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc123410 con 0x7efcdc10f060 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce31576c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc1235d0 con 0x7efcdc122890 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc11d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce29566c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efcdc122890 0x7efcdc122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc11d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44456/0 (socket says 10.20.193.28:44456) 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 -- 10.20.193.28:0/1071907519 learned_addr learned my addr 10.20.193.28:0/1071907519 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 -- 10.20.193.28:0/1071907519 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efcdc122890 msgr2=0x7efcdc122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efcdc122890 0x7efcdc122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 -- 10.20.193.28:0/1071907519 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10f060 msgr2=0x7efcdc11cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce21556c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10f060 0x7efcdc11cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.868+0000 7efce19546c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10f060 0x7efcdc11cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efce19546c0 1 -- 10.20.193.28:0/1071907519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00094c0 con 0x7efcdc115270 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efce21556c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10f060 0x7efcdc11cf90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efce19546c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc11d4d0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd000ba30 tx=0x7efcd000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcd0004460 con 0x7efcdc115270 2026-02-13T01:25:23.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd800a660 con 0x7efcdc115270 2026-02-13T01:25:23.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efcd00045c0 con 0x7efcdc115270 2026-02-13T01:25:23.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcd00071c0 con 0x7efcdc115270 2026-02-13T01:25:23.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.869+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcdc163dd0 con 0x7efcdc115270 2026-02-13T01:25:23.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.870+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcdc110330 con 0x7efcdc115270 2026-02-13T01:25:23.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.872+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7efcd00026b0 con 0x7efcdc115270 2026-02-13T01:25:23.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.874+0000 7efcc37fe6c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efcb80b5680 0x7efcb80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.874+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7efcd00e3680 con 0x7efcdc115270 2026-02-13T01:25:23.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.874+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efcd00e3b00 con 0x7efcdc115270 2026-02-13T01:25:23.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.874+0000 7efce21556c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efcb80b5680 0x7efcb80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.874+0000 7efce21556c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efcb80b5680 0x7efcb80d5b30 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efccc004750 tx=0x7efccc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.997+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcdc163a20 con 0x7efcdc115270 2026-02-13T01:25:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.998+0000 7efcc37fe6c0 1 -- 10.20.193.28:0/1071907519 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7efcd00a6560 con 0x7efcdc115270 2026-02-13T01:25:23.997 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:23.997 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":5,"btime":"2026-02-13T01:25:23:011464+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/2406277277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":2406277277},{"type":"v1","addr":"10.20.193.28:6837","nonce":2406277277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6833/1945194409","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6832","nonce":1945194409},{"type":"v1","addr":"10.20.193.134:6833","nonce":1945194409}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24523,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6833/60649704","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6832","nonce":60649704},{"type":"v1","addr":"10.20.193.187:6833","nonce":60649704}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/1374905070","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":1374905070},{"type":"v1","addr":"10.20.193.28:6835","nonce":1374905070}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2026-02-13T01:25:23.998 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 5 2026-02-13T01:25:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efcb80b5680 msgr2=0x7efcb80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efcb80b5680 0x7efcb80d5b30 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efccc004750 tx=0x7efccc009260 comp rx=0 tx=0).stop 2026-02-13T01:25:23.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 msgr2=0x7efcdc11d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc11d4d0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd000ba30 tx=0x7efcd000bf00 comp rx=0 tx=0).stop 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 shutdown_connections 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efcb80b5680 0x7efcb80d5b30 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efcdc122890 0x7efcdc122d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcdc115270 0x7efcdc11d4d0 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 --2- 10.20.193.28:0/1071907519 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efcdc10f060 0x7efcdc11cf90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 >> 10.20.193.28:0/1071907519 conn(0x7efcdc0ec980 msgr2=0x7efcdc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 shutdown_connections 2026-02-13T01:25:23.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:23.999+0000 7efce31576c0 1 -- 10.20.193.28:0/1071907519 wait complete. 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 podman[55567]: 2026-02-13 01:25:23.629845743 +0000 UTC m=+0.053151291 container init e133be779f690dd4b7b85bb21b072d988f623055f329f2d24e8d6f70f01d1701 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-e, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, license=BSD-3-Clause, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 podman[55567]: 2026-02-13 01:25:23.63195535 +0000 UTC m=+0.055260888 container start e133be779f690dd4b7b85bb21b072d988f623055f329f2d24e8d6f70f01d1701 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-e, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, name=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 bash[55567]: e133be779f690dd4b7b85bb21b072d988f623055f329f2d24e8d6f70f01d1701 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 podman[55567]: 2026-02-13 01:25:23.585747954 +0000 UTC m=+0.009053502 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 systemd[1]: Started Ceph mds.e for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 ceph-mds[55597]: -- 10.20.193.134:0/1664623858 <== mon.2 v2:10.20.193.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c6f430b860 con 0x55c6f43c1000 2026-02-13T01:25:24.015 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:25:23 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-e[55593]: starting mds.e at 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.28:6836/2406277277,v1:10.20.193.28:6837/2406277277] up:boot 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: fsmap 4 up:standby 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:24.060 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1071907519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:24.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.28:6836/2406277277,v1:10.20.193.28:6837/2406277277] up:boot 2026-02-13T01:25:24.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: fsmap 4 up:standby 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1071907519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.28:6836/2406277277,v1:10.20.193.28:6837/2406277277] up:boot 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: fsmap 4 up:standby 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:24.354 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1071907519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:24.643 INFO:journalctl@ceph.mds.f.trial187.stdout:Feb 13 01:25:24 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-f[56858]: starting mds.f at 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.134:6834/528218055,v1:10.20.193.134:6835/528218055] up:boot 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: fsmap 5 up:standby 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:25.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.134:6834/528218055,v1:10.20.193.134:6835/528218055] up:boot 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: fsmap 5 up:standby 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:25 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:25.313 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 podman[57159]: 2026-02-13 01:25:25.315493169 +0000 UTC m=+0.043046005 container init 49e56e8b28e73d3784c76c856aeaa3b15782e6768a780d20ede30c9ca0ac15c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-c, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default) 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.134:6834/528218055,v1:10.20.193.134:6835/528218055] up:boot 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: fsmap 5 up:standby 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:25.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:25 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:25.643 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 podman[57159]: 2026-02-13 01:25:25.317636231 +0000 UTC m=+0.045189067 container start 49e56e8b28e73d3784c76c856aeaa3b15782e6768a780d20ede30c9ca0ac15c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-c, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, OSD_FLAVOR=default, version=10, io.buildah.version=1.33.7) 2026-02-13T01:25:25.643 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 bash[57159]: 49e56e8b28e73d3784c76c856aeaa3b15782e6768a780d20ede30c9ca0ac15c2 2026-02-13T01:25:25.643 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 podman[57159]: 2026-02-13 01:25:25.281175535 +0000 UTC m=+0.008728381 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:25:25.644 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 systemd[1]: Started Ceph mds.c for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:25:25.644 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-mds[57188]: -- 10.20.193.187:0/3864164039 <== mon.1 v2:10.20.193.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bec8245860 con 0x55bec82fb400 2026-02-13T01:25:25.644 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:25:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-c[57184]: starting mds.c at 2026-02-13T01:25:26.104 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:26.288 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.187:6834/1888846931,v1:10.20.193.187:6835/1888846931] up:boot 2026-02-13T01:25:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: fsmap 6 up:standby 2026-02-13T01:25:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:25:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:26.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:26.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:26 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:26.303 INFO:journalctl@ceph.mds.h.trial134.stdout:Feb 13 01:25:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-h[55917]: starting mds.h at 2026-02-13T01:25:26.332 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.187:6834/1888846931,v1:10.20.193.187:6835/1888846931] up:boot 2026-02-13T01:25:26.332 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: fsmap 6 up:standby 2026-02-13T01:25:26.332 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:25:26.332 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.332 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.332 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:26.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:26.333 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:26 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:26.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.187:6834/1888846931,v1:10.20.193.187:6835/1888846931] up:boot 2026-02-13T01:25:26.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: fsmap 6 up:standby 2026-02-13T01:25:26.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:25:26.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:26.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:26.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:26.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:26 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:26.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/551990771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a78117120 msgr2=0x7f9a7815b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 --2- 10.20.193.28:0/551990771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a78117120 0x7f9a7815b7a0 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=15137902590797997827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6c009970 tx=0x7f9a6c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:26.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/551990771 shutdown_connections 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 --2- 10.20.193.28:0/551990771 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a7815bce0 0x7f9a7817c100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 --2- 10.20.193.28:0/551990771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a78117120 0x7f9a7815b7a0 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=15137902590797997827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 --2- 10.20.193.28:0/551990771 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9a78116730 0x7f9a78116b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/551990771 >> 10.20.193.28:0/551990771 conn(0x7f9a7805cef0 msgr2=0x7f9a7805d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/551990771 shutdown_connections 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.486+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/551990771 wait complete. 2026-02-13T01:25:26.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.487+0000 7f9a7f3c56c0 1 Processor -- start 2026-02-13T01:25:26.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.487+0000 7f9a7f3c56c0 1 -- start start 2026-02-13T01:25:26.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.487+0000 7f9a7f3c56c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a78116730 0x7f9a78101400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.487+0000 7f9a7f3c56c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9a78117120 0x7f9a78101940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.487+0000 7f9a7f3c56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a7815bce0 0x7f9a78106d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.487+0000 7f9a7f3c56c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78107350 con 0x7f9a7815bce0 2026-02-13T01:25:26.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7f3c56c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781074c0 con 0x7f9a78117120 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7f3c56c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78107680 con 0x7f9a78116730 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7c9356c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9a78117120 0x7f9a78101940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d1366c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a78116730 0x7f9a78101400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d1366c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a78116730 0x7f9a78101400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:39732/0 (socket says 10.20.193.28:39732) 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d1366c0 1 -- 10.20.193.28:0/2031691139 learned_addr learned my addr 10.20.193.28:0/2031691139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a7815bce0 0x7f9a78106d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 -- 10.20.193.28:0/2031691139 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a78116730 msgr2=0x7f9a78101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a78116730 0x7f9a78101400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 -- 10.20.193.28:0/2031691139 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9a78117120 msgr2=0x7f9a78101940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9a78117120 0x7f9a78101940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 -- 10.20.193.28:0/2031691139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c009590 con 0x7f9a7815bce0 2026-02-13T01:25:26.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7d9376c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a7815bce0 0x7f9a78106d00 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a74006fd0 tx=0x7f9a7400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:26.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a74003c40 con 0x7f9a7815bce0 2026-02-13T01:25:26.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a7400a070 con 0x7f9a7815bce0 2026-02-13T01:25:26.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a7400dd90 con 0x7f9a7815bce0 2026-02-13T01:25:26.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.488+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/2031691139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a78107960 con 0x7f9a7815bce0 2026-02-13T01:25:26.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.489+0000 7f9a7f3c56c0 1 -- 10.20.193.28:0/2031691139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a78157910 con 0x7f9a7815bce0 2026-02-13T01:25:26.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.489+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a78057010 con 0x7f9a7815bce0 2026-02-13T01:25:26.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.491+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f9a74005030 con 0x7f9a7815bce0 2026-02-13T01:25:26.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.493+0000 7f9a667fc6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9a540b5680 0x7f9a540d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.493+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7f9a740e4460 con 0x7f9a7815bce0 2026-02-13T01:25:26.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.493+0000 7f9a7d1366c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9a540b5680 0x7f9a540d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.493+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9a740e48e0 con 0x7f9a7815bce0 2026-02-13T01:25:26.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.493+0000 7f9a7d1366c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9a540b5680 0x7f9a540d5b30 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a680095e0 tx=0x7f9a68009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:26.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.617+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a78116b00 con 0x7f9a7815bce0 2026-02-13T01:25:26.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.617+0000 7f9a667fc6c0 1 -- 10.20.193.28:0/2031691139 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f9a740a7340 con 0x7f9a7815bce0 2026-02-13T01:25:26.618 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:26.618 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":8,"btime":"2026-02-13T01:25:26:023667+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/2406277277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":2406277277},{"type":"v1","addr":"10.20.193.28:6837","nonce":2406277277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6833/1945194409","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6832","nonce":1945194409},{"type":"v1","addr":"10.20.193.134:6833","nonce":1945194409}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24523,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6833/60649704","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6832","nonce":60649704},{"type":"v1","addr":"10.20.193.187:6833","nonce":60649704}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6835/528218055","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6834","nonce":528218055},{"type":"v1","addr":"10.20.193.134:6835","nonce":528218055}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/1374905070","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":1374905070},{"type":"v1","addr":"10.20.193.28:6835","nonce":1374905070}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6835/1888846931","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6834","nonce":1888846931},{"type":"v1","addr":"10.20.193.187:6835","nonce":1888846931}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6837/1413502445","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6836","nonce":1413502445},{"type":"v1","addr":"10.20.193.187:6837","nonce":1413502445}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T01:25:26.619 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 8 2026-02-13T01:25:26.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.618+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9a540b5680 msgr2=0x7f9a540d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.618+0000 7f9a47fff6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9a540b5680 0x7f9a540d5b30 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a680095e0 tx=0x7f9a68009260 comp rx=0 tx=0).stop 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.618+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a7815bce0 msgr2=0x7f9a78106d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.618+0000 7f9a47fff6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a7815bce0 0x7f9a78106d00 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a74006fd0 tx=0x7f9a7400cc00 comp rx=0 tx=0).stop 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.618+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 shutdown_connections 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a7815bce0 0x7f9a78106d00 unknown :-1 s=CLOSED pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9a78117120 0x7f9a78101940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9a540b5680 0x7f9a540d5b30 unknown :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 --2- 10.20.193.28:0/2031691139 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9a78116730 0x7f9a78101400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 >> 10.20.193.28:0/2031691139 conn(0x7f9a7805cef0 msgr2=0x7f9a78114e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 shutdown_connections 2026-02-13T01:25:26.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:26.619+0000 7f9a47fff6c0 1 -- 10.20.193.28:0/2031691139 wait complete. 2026-02-13T01:25:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.187:6836/1413502445,v1:10.20.193.187:6837/1413502445] up:boot 2026-02-13T01:25:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: fsmap 7 up:standby 2026-02-13T01:25:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:27.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:27 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2031691139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.187:6836/1413502445,v1:10.20.193.187:6837/1413502445] up:boot 2026-02-13T01:25:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: fsmap 7 up:standby 2026-02-13T01:25:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:25:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:27.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:27.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:27.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:27.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:27 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2031691139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:27.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.187:6836/1413502445,v1:10.20.193.187:6837/1413502445] up:boot 2026-02-13T01:25:27.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: fsmap 7 up:standby 2026-02-13T01:25:27.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:25:27.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:27.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:27.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:27.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:27.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:27.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:27 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2031691139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.134:6836/583645151,v1:10.20.193.134:6837/583645151] up:boot 2026-02-13T01:25:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.187:6838/2636275695,v1:10.20.193.187:6839/2636275695] up:boot 2026-02-13T01:25:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: fsmap 9 up:standby 2026-02-13T01:25:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:25:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:25:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:28.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:28.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:28 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:28.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.134:6836/583645151,v1:10.20.193.134:6837/583645151] up:boot 2026-02-13T01:25:28.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.187:6838/2636275695,v1:10.20.193.187:6839/2636275695] up:boot 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: fsmap 9 up:standby 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:28.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:28.355 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 systemd[1]: Starting Ceph mds.g for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:25:28.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.134:6836/583645151,v1:10.20.193.134:6837/583645151] up:boot 2026-02-13T01:25:28.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.187:6838/2636275695,v1:10.20.193.187:6839/2636275695] up:boot 2026-02-13T01:25:28.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: fsmap 9 up:standby 2026-02-13T01:25:28.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:28.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:28 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:28.696 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 podman[56751]: 2026-02-13 01:25:28.353900348 +0000 UTC m=+0.027513133 container create 895933f48592be74291045c50c93b7b0bd6121be69813c69ad310654d91125cc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-g, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:25:28.696 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 podman[56751]: 2026-02-13 01:25:28.3911717 +0000 UTC m=+0.064784485 container init 895933f48592be74291045c50c93b7b0bd6121be69813c69ad310654d91125cc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-g, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, summary=Rocky Linux Base image, name=rockylinux, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:25:28.697 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 podman[56751]: 2026-02-13 01:25:28.395930737 +0000 UTC m=+0.069543522 container start 895933f48592be74291045c50c93b7b0bd6121be69813c69ad310654d91125cc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-g, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, version=10) 2026-02-13T01:25:28.697 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 bash[56751]: 895933f48592be74291045c50c93b7b0bd6121be69813c69ad310654d91125cc 2026-02-13T01:25:28.697 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 podman[56751]: 2026-02-13 01:25:28.344236754 +0000 UTC m=+0.017849549 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:25:28.697 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 systemd[1]: Started Ceph mds.g for 70ced355-087a-11f1-9708-d404e6e7d460. 2026-02-13T01:25:28.697 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 ceph-mds[56770]: -- 10.20.193.28:0/890072902 <== mon.1 v2:10.20.193.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f6bbf3860 con 0x555f6bd2c400 2026-02-13T01:25:28.697 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:25:28 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-g[56766]: starting mds.g at 2026-02-13T01:25:28.727 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:28.918 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:29.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/3467772859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410d970 msgr2=0x7fecd41129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/3467772859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410d970 0x7fecd41129b0 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=1619585244319234163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8009970 tx=0x7fecc802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/3467772859 shutdown_connections 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/3467772859 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fecd4113190 0x7fecd4173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/3467772859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410d970 0x7fecd41129b0 unknown :-1 s=CLOSED pgs=66 gs=3 cs=0 l=1 c_cookie=1619585244319234163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/3467772859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd410cf80 0x7fecd410d350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/3467772859 >> 10.20.193.28:0/3467772859 conn(0x7fecd40ea880 msgr2=0x7fecd410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:29.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/3467772859 shutdown_connections 2026-02-13T01:25:29.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.118+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/3467772859 wait complete. 2026-02-13T01:25:29.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 Processor -- start 2026-02-13T01:25:29.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 -- start start 2026-02-13T01:25:29.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 0x7fecd40ef2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fecd4113190 0x7fecd4173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd40ef900 0x7fecd40f4b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40efff0 con 0x7fecd40ef900 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40f50c0 con 0x7fecd410cf80 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.119+0000 7fecdc70b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fecd40f5280 con 0x7fecd4113190 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 0x7fecd40ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 0x7fecd40ef2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:54208/0 (socket says 10.20.193.28:54208) 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 -- 10.20.193.28:0/192858423 learned_addr learned my addr 10.20.193.28:0/192858423 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecdac7d6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd40ef900 0x7fecd40f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecd9c7b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fecd4113190 0x7fecd4173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:29.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 -- 10.20.193.28:0/192858423 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fecd4113190 msgr2=0x7fecd4173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fecd4113190 0x7fecd4173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 -- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd40ef900 msgr2=0x7fecd40f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd40ef900 0x7fecd40f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.120+0000 7fecda47c6c0 1 -- 10.20.193.28:0/192858423 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc8009590 con 0x7fecd410cf80 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.121+0000 7fecda47c6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 0x7fecd40ef2d0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc4009fd0 tx=0x7fecc400bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.121+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc4004a80 con 0x7fecd410cf80 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.121+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecc4009030 con 0x7fecd410cf80 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.121+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc40056e0 con 0x7fecd410cf80 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.121+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd40f5560 con 0x7fecd410cf80 2026-02-13T01:25:29.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.121+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd40f59f0 con 0x7fecd410cf80 2026-02-13T01:25:29.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.122+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd410e250 con 0x7fecd410cf80 2026-02-13T01:25:29.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.124+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fecc4004c70 con 0x7fecd410cf80 2026-02-13T01:25:29.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.126+0000 7fecbb7fe6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fecb00b5680 0x7fecb00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:29.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.126+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7fecc40e34c0 con 0x7fecd410cf80 2026-02-13T01:25:29.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.126+0000 7fecd9c7b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fecb00b5680 0x7fecb00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:29.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.126+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fecc40e3940 con 0x7fecd410cf80 2026-02-13T01:25:29.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.127+0000 7fecd9c7b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fecb00b5680 0x7fecb00d5b30 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc80023e0 tx=0x7fecc802f5a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.253+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecd40f59f0 con 0x7fecd410cf80 2026-02-13T01:25:29.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.254+0000 7fecbb7fe6c0 1 -- 10.20.193.28:0/192858423 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8868 (secure 0 0 0) 0x7fecd40f59f0 con 0x7fecd410cf80 2026-02-13T01:25:29.255 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:29.255 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":10,"btime":"2026-02-13T01:25:29:033958+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/2406277277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":2406277277},{"type":"v1","addr":"10.20.193.28:6837","nonce":2406277277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/723111471","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":723111471},{"type":"v1","addr":"10.20.193.28:6839","nonce":723111471}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6833/1945194409","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6832","nonce":1945194409},{"type":"v1","addr":"10.20.193.134:6833","nonce":1945194409}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24523,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6833/60649704","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6832","nonce":60649704},{"type":"v1","addr":"10.20.193.187:6833","nonce":60649704}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6835/528218055","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6834","nonce":528218055},{"type":"v1","addr":"10.20.193.134:6835","nonce":528218055}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/1374905070","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":1374905070},{"type":"v1","addr":"10.20.193.28:6835","nonce":1374905070}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6837/583645151","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6836","nonce":583645151},{"type":"v1","addr":"10.20.193.134:6837","nonce":583645151}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6835/1888846931","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6834","nonce":1888846931},{"type":"v1","addr":"10.20.193.187:6835","nonce":1888846931}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6837/1413502445","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6836","nonce":1413502445},{"type":"v1","addr":"10.20.193.187:6837","nonce":1413502445}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6839/2636275695","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6838","nonce":2636275695},{"type":"v1","addr":"10.20.193.187:6839","nonce":2636275695}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-13T01:25:29.255 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 10 2026-02-13T01:25:29.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fecb00b5680 msgr2=0x7fecb00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fecb00b5680 0x7fecb00d5b30 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc80023e0 tx=0x7fecc802f5a0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 msgr2=0x7fecd40ef2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 0x7fecd40ef2d0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc4009fd0 tx=0x7fecc400bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 shutdown_connections 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fecb00b5680 0x7fecb00d5b30 unknown :-1 s=CLOSED pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fecd4113190 0x7fecd4173a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fecd40ef900 0x7fecd40f4b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 --2- 10.20.193.28:0/192858423 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fecd410cf80 0x7fecd40ef2d0 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:29.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 >> 10.20.193.28:0/192858423 conn(0x7fecd40ea880 msgr2=0x7fecd410b440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:29.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 shutdown_connections 2026-02-13T01:25:29.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:29.256+0000 7fecdc70b6c0 1 -- 10.20.193.28:0/192858423 wait complete. 2026-02-13T01:25:29.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:29.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.28:6838/723111471,v1:10.20.193.28:6839/723111471] up:boot 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: fsmap 10 up:standby 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:25:29.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/192858423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:29.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:29.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:29.802 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:29.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:29.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.28:6838/723111471,v1:10.20.193.28:6839/723111471] up:boot 2026-02-13T01:25:29.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: fsmap 10 up:standby 2026-02-13T01:25:29.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:25:29.803 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:29 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/192858423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:29.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:29.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.28:6838/723111471,v1:10.20.193.28:6839/723111471] up:boot 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: fsmap 10 up:standby 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:25:29.894 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:29 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/192858423' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:29.946 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 13 01:25:29 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-a[57139]: starting mds.a at 2026-02-13T01:25:30.802 INFO:journalctl@ceph.mds.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-b[56241]: starting mds.b at 2026-02-13T01:25:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.28:6840/523456134,v1:10.20.193.28:6841/523456134] up:boot 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: fsmap 11 up:standby 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:30 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:31.170 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.170 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.28:6840/523456134,v1:10.20.193.28:6841/523456134] up:boot 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: fsmap 11 up:standby 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.171 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.172 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.172 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.172 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:30 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.28:6840/523456134,v1:10.20.193.28:6841/523456134] up:boot 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: fsmap 11 up:standby 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:30 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:31.438 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:31.633 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.841+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3831014390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c74115410 msgr2=0x7f2c74175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.841+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3831014390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c74115410 0x7f2c74175db0 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=2651953216610665096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c6800aa70 tx=0x7f2c6802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3831014390 shutdown_connections 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3831014390 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c7410fbf0 0x7f2c74114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3831014390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c74115410 0x7f2c74175db0 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=2651953216610665096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3831014390 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2c7410f200 0x7f2c7410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3831014390 >> 10.20.193.28:0/3831014390 conn(0x7f2c740ecb00 msgr2=0x7f2c7410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3831014390 shutdown_connections 2026-02-13T01:25:31.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3831014390 wait complete. 2026-02-13T01:25:31.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 Processor -- start 2026-02-13T01:25:31.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.842+0000 7f2c7a8f36c0 1 -- start start 2026-02-13T01:25:31.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c7a8f36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c7410f200 0x7f2c7411d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c7a8f36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 0x7f2c7411d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c7a8f36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2c74122a70 0x7f2c74122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c7a8f36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2c74123480 con 0x7f2c7410f200 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c7a8f36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741235f0 con 0x7f2c74122a70 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c7a8f36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741237b0 con 0x7f2c74115410 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 0x7f2c7411d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 0x7f2c7411d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:39828/0 (socket says 10.20.193.28:39828) 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 -- 10.20.193.28:0/3006635009 learned_addr learned my addr 10.20.193.28:0/3006635009 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c73fff6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c7410f200 0x7f2c7411d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c78e656c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2c74122a70 0x7f2c74122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 -- 10.20.193.28:0/3006635009 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2c74122a70 msgr2=0x7f2c74122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2c74122a70 0x7f2c74122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 -- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c7410f200 msgr2=0x7f2c7411d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c7410f200 0x7f2c7411d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.843+0000 7f2c737fe6c0 1 -- 10.20.193.28:0/3006635009 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6800a660 con 0x7f2c74115410 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c737fe6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 0x7f2c7411d6b0 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c6400b750 tx=0x7f2c6400bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c64004a80 con 0x7f2c74115410 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2c64009030 con 0x7f2c74115410 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c74163c60 con 0x7f2c74115410 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c6400cdd0 con 0x7f2c74115410 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c741640f0 con 0x7f2c74115410 2026-02-13T01:25:31.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.844+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c741104d0 con 0x7f2c74115410 2026-02-13T01:25:31.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.847+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f2c64005020 con 0x7f2c74115410 2026-02-13T01:25:31.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.848+0000 7f2c717fa6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2c480b5600 0x7f2c480d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.849+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7f2c640e3570 con 0x7f2c74115410 2026-02-13T01:25:31.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.849+0000 7f2c73fff6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2c480b5600 0x7f2c480d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.849+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c640e39f0 con 0x7f2c74115410 2026-02-13T01:25:31.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.849+0000 7f2c73fff6c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2c480b5600 0x7f2c480d5ab0 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c60004750 tx=0x7f2c60009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.134:6838/522432871,v1:10.20.193.134:6839/522432871] up:boot 2026-02-13T01:25:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: fsmap 12 up:standby 2026-02-13T01:25:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:25:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:31 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:31.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.974+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c7411e2c0 con 0x7f2c74115410 2026-02-13T01:25:31.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.974+0000 7f2c717fa6c0 1 -- 10.20.193.28:0/3006635009 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10517 (secure 0 0 0) 0x7f2c640a6450 con 0x7f2c74115410 2026-02-13T01:25:31.975 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:31.975 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":12,"btime":"2026-02-13T01:25:31:456773+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/2406277277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":2406277277},{"type":"v1","addr":"10.20.193.28:6837","nonce":2406277277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/723111471","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":723111471},{"type":"v1","addr":"10.20.193.28:6839","nonce":723111471}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/523456134","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":523456134},{"type":"v1","addr":"10.20.193.28:6841","nonce":523456134}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6833/1945194409","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6832","nonce":1945194409},{"type":"v1","addr":"10.20.193.134:6833","nonce":1945194409}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24523,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6833/60649704","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6832","nonce":60649704},{"type":"v1","addr":"10.20.193.187:6833","nonce":60649704}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6835/528218055","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6834","nonce":528218055},{"type":"v1","addr":"10.20.193.134:6835","nonce":528218055}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/1374905070","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":1374905070},{"type":"v1","addr":"10.20.193.28:6835","nonce":1374905070}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6837/583645151","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6836","nonce":583645151},{"type":"v1","addr":"10.20.193.134:6837","nonce":583645151}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6835/1888846931","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6834","nonce":1888846931},{"type":"v1","addr":"10.20.193.187:6835","nonce":1888846931}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6837/1413502445","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6836","nonce":1413502445},{"type":"v1","addr":"10.20.193.187:6837","nonce":1413502445}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6839/522432871","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6838","nonce":522432871},{"type":"v1","addr":"10.20.193.134:6839","nonce":522432871}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6839/2636275695","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6838","nonce":2636275695},{"type":"v1","addr":"10.20.193.187:6839","nonce":2636275695}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-13T01:25:31.976 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 12 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2c480b5600 msgr2=0x7f2c480d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2c480b5600 0x7f2c480d5ab0 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c60004750 tx=0x7f2c60009260 comp rx=0 tx=0).stop 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 msgr2=0x7f2c7411d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 0x7f2c7411d6b0 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c6400b750 tx=0x7f2c6400bc20 comp rx=0 tx=0).stop 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 shutdown_connections 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2c480b5600 0x7f2c480d5ab0 unknown :-1 s=CLOSED pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2c74115410 0x7f2c7411d6b0 unknown :-1 s=CLOSED pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2c74122a70 0x7f2c74122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 --2- 10.20.193.28:0/3006635009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2c7410f200 0x7f2c7411d170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.976+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 >> 10.20.193.28:0/3006635009 conn(0x7f2c740ecb00 msgr2=0x7f2c7410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:31.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.977+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 shutdown_connections 2026-02-13T01:25:31.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:31.977+0000 7f2c7a8f36c0 1 -- 10.20.193.28:0/3006635009 wait complete. 2026-02-13T01:25:32.118 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T01:25:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.134:6838/522432871,v1:10.20.193.134:6839/522432871] up:boot 2026-02-13T01:25:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: fsmap 12 up:standby 2026-02-13T01:25:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:25:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:31 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.301 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.134:6838/522432871,v1:10.20.193.134:6839/522432871] up:boot 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: fsmap 12 up:standby 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:31 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:32.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1422395479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c11b9e0 msgr2=0x7f397c17c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1422395479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c11b9e0 0x7f397c17c380 secure :-1 s=READY pgs=168 gs=1 cs=0 l=1 c_cookie=17040067481112698879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f397000aa70 tx=0x7f397002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1422395479 shutdown_connections 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1422395479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c11b9e0 0x7f397c17c380 unknown :-1 s=CLOSED pgs=168 gs=1 cs=0 l=1 c_cookie=17040067481112698879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1422395479 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f397c0572c0 0x7f397c11b200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1422395479 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f397c0568d0 0x7f397c056ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1422395479 >> 10.20.193.28:0/1422395479 conn(0x7f397c05cd60 msgr2=0x7f397c05d160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.497+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1422395479 shutdown_connections 2026-02-13T01:25:32.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.498+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1422395479 wait complete. 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.498+0000 7f3980edf6c0 1 Processor -- start 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.498+0000 7f3980edf6c0 1 -- start start 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.498+0000 7f3980edf6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 0x7f397c1236d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.498+0000 7f3980edf6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f397c11b9e0 0x7f397c123c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3980edf6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f397c128fd0 0x7f397c129470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3980edf6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1299e0 con 0x7f397c0568d0 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3980edf6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f397c129b50 con 0x7f397c11b9e0 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3980edf6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f397c129d10 con 0x7f397c128fd0 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 0x7f397c1236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 0x7f397c1236d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49688/0 (socket says 10.20.193.28:49688) 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 -- 10.20.193.28:0/1476057799 learned_addr learned my addr 10.20.193.28:0/1476057799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:32.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397bfff6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f397c128fd0 0x7f397c129470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397affd6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f397c11b9e0 0x7f397c123c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 -- 10.20.193.28:0/1476057799 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f397c128fd0 msgr2=0x7f397c129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f397c128fd0 0x7f397c129470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 -- 10.20.193.28:0/1476057799 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f397c11b9e0 msgr2=0x7f397c123c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f397c11b9e0 0x7f397c123c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 -- 10.20.193.28:0/1476057799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397000a660 con 0x7f397c0568d0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f397b7fe6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 0x7f397c1236d0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3968005dc0 tx=0x7f396800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3968004250 con 0x7f397c0568d0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3968009070 con 0x7f397c0568d0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f396800cde0 con 0x7f397c0568d0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c16a1c0 con 0x7f397c0568d0 2026-02-13T01:25:32.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.499+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c16a650 con 0x7f397c0568d0 2026-02-13T01:25:32.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.500+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c116aa0 con 0x7f397c0568d0 2026-02-13T01:25:32.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.502+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f39680028c0 con 0x7f397c0568d0 2026-02-13T01:25:32.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.504+0000 7f3978ff96c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39500b5680 0x7f39500d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:32.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.504+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7f39680e3630 con 0x7f397c0568d0 2026-02-13T01:25:32.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.504+0000 7f397affd6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39500b5680 0x7f39500d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:32.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.504+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f39680e3ab0 con 0x7f397c0568d0 2026-02-13T01:25:32.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.505+0000 7f397affd6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39500b5680 0x7f39500d5b30 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f396c005980 tx=0x7f396c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:32.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.609+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f397c124820 con 0x7f397c0568d0 2026-02-13T01:25:32.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.609+0000 7f3978ff96c0 1 -- 10.20.193.28:0/1476057799 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f39680a6510 con 0x7f397c0568d0 2026-02-13T01:25:32.609 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:32.610 INFO:teuthology.orchestra.run.trial028.stdout:[ 2026-02-13T01:25:32.610 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-13T01:25:32.610 INFO:teuthology.orchestra.run.trial028.stdout: "poolnum": 1, 2026-02-13T01:25:32.610 INFO:teuthology.orchestra.run.trial028.stdout: "poolname": ".mgr" 2026-02-13T01:25:32.610 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-13T01:25:32.610 INFO:teuthology.orchestra.run.trial028.stdout:] 2026-02-13T01:25:32.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.610+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39500b5680 msgr2=0x7f39500d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.610+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39500b5680 0x7f39500d5b30 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f396c005980 tx=0x7f396c005910 comp rx=0 tx=0).stop 2026-02-13T01:25:32.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.610+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 msgr2=0x7f397c1236d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:32.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.610+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 0x7f397c1236d0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3968005dc0 tx=0x7f396800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 shutdown_connections 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39500b5680 0x7f39500d5b30 unknown :-1 s=CLOSED pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f397c128fd0 0x7f397c129470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f397c11b9e0 0x7f397c123c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 --2- 10.20.193.28:0/1476057799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f397c0568d0 0x7f397c1236d0 unknown :-1 s=CLOSED pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 >> 10.20.193.28:0/1476057799 conn(0x7f397c05cd60 msgr2=0x7f397c05d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 shutdown_connections 2026-02-13T01:25:32.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:32.611+0000 7f3980edf6c0 1 -- 10.20.193.28:0/1476057799 wait complete. 2026-02-13T01:25:32.715 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T01:25:32.715 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T01:25:32.900 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:33.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/3888080404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81137a0 msgr2=0x7fedb8113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/3888080404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81137a0 0x7fedb8113b70 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=6118467601612149214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feda4009970 tx=0x7feda402ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/3888080404 shutdown_connections 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/3888080404 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fedb8114190 0x7fedb8119140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/3888080404 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81198f0 0x7fedb817a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/3888080404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81137a0 0x7fedb8113b70 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=6118467601612149214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/3888080404 >> 10.20.193.28:0/3888080404 conn(0x7fedb8060760 msgr2=0x7fedb8060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/3888080404 shutdown_connections 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.117+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/3888080404 wait complete. 2026-02-13T01:25:33.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.118+0000 7fedbe1b76c0 1 Processor -- start 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.118+0000 7fedbe1b76c0 1 -- start start 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.118+0000 7fedbe1b76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 0x7fedb81216d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.118+0000 7fedbe1b76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81198f0 0x7fedb8121c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedbe1b76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fedb8126fd0 0x7fedb8127470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedbe1b76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fedb81279e0 con 0x7fedb81198f0 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 0x7fedb81216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 0x7fedb81216d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:54280/0 (socket says 10.20.193.28:54280) 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 -- 10.20.193.28:0/2877139291 learned_addr learned my addr 10.20.193.28:0/2877139291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8127b50 con 0x7fedb81137a0 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8127d10 con 0x7fedb8126fd0 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb6ffd6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81198f0 0x7fedb8121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:33.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb7fff6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fedb8126fd0 0x7fedb8127470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:33.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 -- 10.20.193.28:0/2877139291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fedb8126fd0 msgr2=0x7fedb8127470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:33.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fedb8126fd0 0x7fedb8127470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:33.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 -- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81198f0 msgr2=0x7fedb8121c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:33.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81198f0 0x7fedb8121c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:33.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.119+0000 7fedb77fe6c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda4009590 con 0x7fedb81137a0 2026-02-13T01:25:33.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.120+0000 7fedb77fe6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 0x7fedb81216d0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feda4031fd0 tx=0x7feda40047f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:33.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.120+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feda4002ae0 con 0x7fedb81137a0 2026-02-13T01:25:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.120+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb8168160 con 0x7fedb81137a0 2026-02-13T01:25:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.120+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb81685e0 con 0x7fedb81137a0 2026-02-13T01:25:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.120+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feda4007740 con 0x7fedb81137a0 2026-02-13T01:25:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.120+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feda4031340 con 0x7fedb81137a0 2026-02-13T01:25:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.121+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb81149e0 con 0x7fedb81137a0 2026-02-13T01:25:33.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.123+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7feda4002c40 con 0x7fedb81137a0 2026-02-13T01:25:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.124+0000 7fedb4ff96c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fed8c0b5680 0x7fed8c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.124+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6904+0+0 (secure 0 0 0) 0x7feda41077a0 con 0x7fedb81137a0 2026-02-13T01:25:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.125+0000 7fedb6ffd6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fed8c0b5680 0x7fed8c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.125+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feda40ca6c0 con 0x7fedb81137a0 2026-02-13T01:25:33.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.125+0000 7fedb6ffd6c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fed8c0b5680 0x7fed8c0d5b30 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feda8005980 tx=0x7feda8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3006635009' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1476057799' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:25:33.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:32 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:33.148 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3006635009' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:33.148 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.148 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1476057799' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:25:33.149 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:32 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3006635009' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1476057799' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:25:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:32 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:33.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:33.227+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fedb8113b70 con 0x7fedb81137a0 2026-02-13T01:25:34.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.123+0000 7fedb4ff96c0 1 -- 10.20.193.28:0/2877139291 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7feda40cd870 con 0x7fedb81137a0 2026-02-13T01:25:34.124 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' created 2026-02-13T01:25:34.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fed8c0b5680 msgr2=0x7fed8c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:34.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fed8c0b5680 0x7fed8c0d5b30 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feda8005980 tx=0x7feda8005910 comp rx=0 tx=0).stop 2026-02-13T01:25:34.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 msgr2=0x7fedb81216d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:34.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 0x7fedb81216d0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feda4031fd0 tx=0x7feda40047f0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 shutdown_connections 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fed8c0b5680 0x7fed8c0d5b30 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fedb8126fd0 0x7fedb8127470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedb81198f0 0x7fedb8121c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 --2- 10.20.193.28:0/2877139291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fedb81137a0 0x7fedb81216d0 unknown :-1 s=CLOSED pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 >> 10.20.193.28:0/2877139291 conn(0x7fedb8060760 msgr2=0x7fedb8114ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 shutdown_connections 2026-02-13T01:25:34.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.127+0000 7fedbe1b76c0 1 -- 10.20.193.28:0/2877139291 wait complete. 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2877139291' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.155 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:33 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.231 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2877139291' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:33 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.372 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2877139291' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.373 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:33 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:34.415 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:34.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 -- 10.20.193.28:0/2262923828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec010b730 msgr2=0x7efec0110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:34.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 --2- 10.20.193.28:0/2262923828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec010b730 0x7efec0110590 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=8266001319525689940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb4009970 tx=0x7efeb402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:34.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 -- 10.20.193.28:0/2262923828 shutdown_connections 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 --2- 10.20.193.28:0/2262923828 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec0110d40 0x7efec0111700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 --2- 10.20.193.28:0/2262923828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec010b730 0x7efec0110590 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=8266001319525689940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 --2- 10.20.193.28:0/2262923828 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010ad40 0x7efec010b110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 -- 10.20.193.28:0/2262923828 >> 10.20.193.28:0/2262923828 conn(0x7efec00638a0 msgr2=0x7efec0109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 -- 10.20.193.28:0/2262923828 shutdown_connections 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.609+0000 7efec62b76c0 1 -- 10.20.193.28:0/2262923828 wait complete. 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 Processor -- start 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 -- start start 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010ad40 0x7efec0122670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 0x7efec0122bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:34.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec0127f70 0x7efec0128410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efec0128980 con 0x7efec0110d40 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7efec0128af0 con 0x7efec010ad40 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec62b76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7efec0128cb0 con 0x7efec0127f70 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec4ab46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 0x7efec0122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec4ab46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 0x7efec0122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49734/0 (socket says 10.20.193.28:49734) 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec4ab46c0 1 -- 10.20.193.28:0/3538080910 learned_addr learned my addr 10.20.193.28:0/3538080910 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec5ab66c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec0127f70 0x7efec0128410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.610+0000 7efec52b56c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010ad40 0x7efec0122670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec4ab46c0 1 -- 10.20.193.28:0/3538080910 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec0127f70 msgr2=0x7efec0128410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec4ab46c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec0127f70 0x7efec0128410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec4ab46c0 1 -- 10.20.193.28:0/3538080910 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010ad40 msgr2=0x7efec0122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec4ab46c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010ad40 0x7efec0122670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec4ab46c0 1 -- 10.20.193.28:0/3538080910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb4009590 con 0x7efec0110d40 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec4ab46c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 0x7efec0122bb0 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb40098c0 tx=0x7efeb40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb4002ae0 con 0x7efec0110d40 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec0169100 con 0x7efec0110d40 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efeb4007740 con 0x7efec0110d40 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec0169580 con 0x7efec0110d40 2026-02-13T01:25:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.611+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb4031600 con 0x7efec0110d40 2026-02-13T01:25:34.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.612+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec010be30 con 0x7efec0110d40 2026-02-13T01:25:34.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.614+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7efeb4002c40 con 0x7efec0110d40 2026-02-13T01:25:34.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.616+0000 7efeae7fc6c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5680 0x7efe9c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:34.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.616+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7277+0+0 (secure 0 0 0) 0x7efeb41079f0 con 0x7efec0110d40 2026-02-13T01:25:34.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.616+0000 7efec52b56c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5680 0x7efe9c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:34.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.616+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efeb41405e0 con 0x7efec0110d40 2026-02-13T01:25:34.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.617+0000 7efec52b56c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5680 0x7efe9c0d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb0005fd0 tx=0x7efeb0009590 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:34.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:34.716+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efec01237c0 con 0x7efec0110d40 2026-02-13T01:25:35.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.124+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/3538080910 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7efeb40ca760 con 0x7efec0110d40 2026-02-13T01:25:35.124 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' created 2026-02-13T01:25:35.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.129+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5680 msgr2=0x7efe9c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.129+0000 7efec62b76c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5680 0x7efe9c0d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb0005fd0 tx=0x7efeb0009590 comp rx=0 tx=0).stop 2026-02-13T01:25:35.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.129+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 msgr2=0x7efec0122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.129+0000 7efec62b76c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 0x7efec0122bb0 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb40098c0 tx=0x7efeb40047f0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 shutdown_connections 2026-02-13T01:25:35.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5680 0x7efe9c0d5b30 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec0127f70 0x7efec0128410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0110d40 0x7efec0122bb0 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 --2- 10.20.193.28:0/3538080910 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010ad40 0x7efec0122670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 >> 10.20.193.28:0/3538080910 conn(0x7efec00638a0 msgr2=0x7efec010f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:35.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 shutdown_connections 2026-02-13T01:25:35.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.130+0000 7efec62b76c0 1 -- 10.20.193.28:0/3538080910 wait complete. 2026-02-13T01:25:35.272 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T01:25:35.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:35.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:35.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: pgmap v192: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:35.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:35 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3538080910' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:25:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: pgmap v192: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:35.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:35 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3538080910' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:25:35.453 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:35.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:35.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:25:35.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:25:35.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: pgmap v192: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:35.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:35 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3538080910' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/2406228619 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410b550 msgr2=0x7fa8c4173910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/2406228619 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410b550 0x7fa8c4173910 secure :-1 s=READY pgs=76 gs=3 cs=0 l=1 c_cookie=15918680879800457131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8c000aa70 tx=0x7fa8c002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/2406228619 shutdown_connections 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/2406228619 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410b550 0x7fa8c4173910 unknown :-1 s=CLOSED pgs=76 gs=3 cs=0 l=1 c_cookie=15918680879800457131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/2406228619 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410abe0 0x7fa8c410b010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/2406228619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8c4112bf0 0x7fa8c4112fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/2406228619 >> 10.20.193.28:0/2406228619 conn(0x7fa8c40638a0 msgr2=0x7fa8c4109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:35.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/2406228619 shutdown_connections 2026-02-13T01:25:35.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.647+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/2406228619 wait complete. 2026-02-13T01:25:35.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 Processor -- start 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 -- start start 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410abe0 0x7fa8c40f47e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 0x7fa8c41738b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8c4112bf0 0x7fa8c40f4fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40fa150 con 0x7fa8c4112bf0 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40fa2c0 con 0x7fa8c410b550 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c9ddb6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40fa480 con 0x7fa8c410abe0 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c8dd96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410abe0 0x7fa8c40f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8bbfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 0x7fa8c41738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8bbfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 0x7fa8c41738b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:54306/0 (socket says 10.20.193.28:54306) 2026-02-13T01:25:35.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8bbfff6c0 1 -- 10.20.193.28:0/764354595 learned_addr learned my addr 10.20.193.28:0/764354595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c8dd96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410abe0 0x7fa8c40f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:39894/0 (socket says 10.20.193.28:39894) 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.648+0000 7fa8c95da6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8c4112bf0 0x7fa8c40f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8bbfff6c0 1 -- 10.20.193.28:0/764354595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410abe0 msgr2=0x7fa8c40f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8bbfff6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410abe0 0x7fa8c40f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8bbfff6c0 1 -- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8c4112bf0 msgr2=0x7fa8c40f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8bbfff6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8c4112bf0 0x7fa8c40f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8bbfff6c0 1 -- 10.20.193.28:0/764354595 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b40094c0 con 0x7fa8c410b550 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8bbfff6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 0x7fa8c41738b0 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac009490 tx=0x7fa8ac00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ac004a80 con 0x7fa8c410b550 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa8ac009030 con 0x7fa8c410b550 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ac00ce50 con 0x7fa8c410b550 2026-02-13T01:25:35.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c000a660 con 0x7fa8c410b550 2026-02-13T01:25:35.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.649+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c40faa60 con 0x7fa8c410b550 2026-02-13T01:25:35.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.650+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c410be00 con 0x7fa8c410b550 2026-02-13T01:25:35.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.652+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fa8ac004ce0 con 0x7fa8c410b550 2026-02-13T01:25:35.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.654+0000 7fa8b9ffb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa8a00b5680 0x7fa8a00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.654+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7662+0+0 (secure 0 0 0) 0x7fa8ac0e38a0 con 0x7fa8c410b550 2026-02-13T01:25:35.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.654+0000 7fa8c8dd96c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa8a00b5680 0x7fa8a00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.654+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa8ac0e3d20 con 0x7fa8c410b550 2026-02-13T01:25:35.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.654+0000 7fa8c8dd96c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa8a00b5680 0x7fa8a00d5b30 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8b4004750 tx=0x7fa8b4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:35.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:35.776+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa8c410b010 con 0x7fa8c410b550 2026-02-13T01:25:36.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.134+0000 7fa8b9ffb6c0 1 -- 10.20.193.28:0/764354595 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7fa8ac0a6490 con 0x7fa8c410b550 2026-02-13T01:25:36.135 INFO:teuthology.orchestra.run.trial028.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T01:25:36.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa8a00b5680 msgr2=0x7fa8a00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa8a00b5680 0x7fa8a00d5b30 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8b4004750 tx=0x7fa8b4009260 comp rx=0 tx=0).stop 2026-02-13T01:25:36.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 msgr2=0x7fa8c41738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 0x7fa8c41738b0 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac009490 tx=0x7fa8ac00bc50 comp rx=0 tx=0).stop 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 shutdown_connections 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa8c4112bf0 0x7fa8c40f4fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa8c410b550 0x7fa8c41738b0 unknown :-1 s=CLOSED pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa8a00b5680 0x7fa8a00d5b30 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 --2- 10.20.193.28:0/764354595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa8c410abe0 0x7fa8c40f47e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 >> 10.20.193.28:0/764354595 conn(0x7fa8c40638a0 msgr2=0x7fa8c4111660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 shutdown_connections 2026-02-13T01:25:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.139+0000 7fa8c9ddb6c0 1 -- 10.20.193.28:0/764354595 wait complete. 2026-02-13T01:25:36.245 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:36 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3538080910' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:25:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:36 trial187 ceph-mon[27464]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:25:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:36 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:36.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:36 trial187 ceph-mon[27464]: daemon mds.i assigned to filesystem cephfs as rank 0 2026-02-13T01:25:36.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:36 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/764354595' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:36.427 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:36.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:36 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3538080910' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:25:36.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:36 trial028 ceph-mon[22984]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:25:36.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:36 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:36.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:36 trial028 ceph-mon[22984]: daemon mds.i assigned to filesystem cephfs as rank 0 2026-02-13T01:25:36.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:36 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/764354595' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:36.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:36 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3538080910' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:25:36.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:36 trial134 ceph-mon[27948]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:25:36.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:36 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:36.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:36 trial134 ceph-mon[27948]: daemon mds.i assigned to filesystem cephfs as rank 0 2026-02-13T01:25:36.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:36 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/764354595' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/1845050028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10fa50 msgr2=0x7f6f0c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/1845050028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10fa50 0x7f6f0c114a90 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=5660569053041146573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ef40099a0 tx=0x7f6ef402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/1845050028 shutdown_connections 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/1845050028 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6f0c115270 0x7f6f0c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/1845050028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10fa50 0x7f6f0c114a90 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=5660569053041146573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/1845050028 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6f0c10f060 0x7f6f0c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/1845050028 >> 10.20.193.28:0/1845050028 conn(0x7f6f0c0ec980 msgr2=0x7f6f0c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:36.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/1845050028 shutdown_connections 2026-02-13T01:25:36.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.636+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/1845050028 wait complete. 2026-02-13T01:25:36.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 Processor -- start 2026-02-13T01:25:36.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 -- start start 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 0x7f6f0c0f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6f0c115270 0x7f6f0c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6f0c0f4ff0 0x7f6f0c0fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c0f56e0 con 0x7f6f0c10f060 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c0fa7b0 con 0x7f6f0c115270 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0b5776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c0fa970 con 0x7f6f0c0f4ff0 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0a5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 0x7f6f0c0f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0a5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 0x7f6f0c0f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34428/0 (socket says 10.20.193.28:34428) 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0a5756c0 1 -- 10.20.193.28:0/680412705 learned_addr learned my addr 10.20.193.28:0/680412705 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:36.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f09d746c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6f0c115270 0x7f6f0c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.637+0000 7f6f0ad766c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6f0c0f4ff0 0x7f6f0c0fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0a5756c0 1 -- 10.20.193.28:0/680412705 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6f0c0f4ff0 msgr2=0x7f6f0c0fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0a5756c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6f0c0f4ff0 0x7f6f0c0fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0a5756c0 1 -- 10.20.193.28:0/680412705 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6f0c115270 msgr2=0x7f6f0c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0a5756c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6f0c115270 0x7f6f0c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0a5756c0 1 -- 10.20.193.28:0/680412705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f000094c0 con 0x7f6f0c10f060 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0a5756c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 0x7f6f0c0f49c0 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f0000ba30 tx=0x7f6f0000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f000044a0 con 0x7f6f0c10f060 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f00009030 con 0x7f6f0c10f060 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f000071c0 con 0x7f6f0c10f060 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef4009590 con 0x7f6f0c10f060 2026-02-13T01:25:36.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.638+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0c0faf50 con 0x7f6f0c10f060 2026-02-13T01:25:36.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.639+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0c110330 con 0x7f6f0c10f060 2026-02-13T01:25:36.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.641+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f6f000026b0 con 0x7f6f0c10f060 2026-02-13T01:25:36.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.643+0000 7f6ef37fe6c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6ee40b5680 0x7f6ee40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:36.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.643+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7762+0+0 (secure 0 0 0) 0x7f6f000e3950 con 0x7f6f0c10f060 2026-02-13T01:25:36.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.643+0000 7f6f09d746c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6ee40b5680 0x7f6ee40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:36.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.643+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6f000e3dd0 con 0x7f6f0c10f060 2026-02-13T01:25:36.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.644+0000 7f6f09d746c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6ee40b5680 0x7f6ee40d5b30 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f0c0fb300 tx=0x7f6ef40023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:36.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.744+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f0c10f430 con 0x7f6f0c10f060 2026-02-13T01:25:36.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.745+0000 7f6ef37fe6c0 1 -- 10.20.193.28:0/680412705 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22051 (secure 0 0 0) 0x7f6f000a6560 con 0x7f6f0c10f060 2026-02-13T01:25:36.746 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:36.746 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":74,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","created":"2026-02-13T01:22:41.806447+0000","modified":"2026-02-13T01:25:35.778073+0000","last_up_change":"2026-02-13T01:25:14.875697+0000","last_in_change":"2026-02-13T01:25:06.785151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:58.205191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:33.235628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:34.724553+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b609cc73-d28a-4ba8-9724-13ee6cc98de8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6803","nonce":2961143377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6805","nonce":2961143377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6809","nonce":2961143377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6807","nonce":2961143377}]},"public_addr":"10.20.193.28:6803/2961143377","cluster_addr":"10.20.193.28:6805/2961143377","heartbeat_back_addr":"10.20.193.28:6809/2961143377","heartbeat_front_addr":"10.20.193.28:6807/2961143377","state":["exists","up"]},{"osd":1,"uuid":"8b21607c-6340-49b2-ae85-eb92729919c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6800","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6801","nonce":2922978638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6802","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6803","nonce":2922978638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6806","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6807","nonce":2922978638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6804","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6805","nonce":2922978638}]},"public_addr":"10.20.193.134:6801/2922978638","cluster_addr":"10.20.193.134:6803/2922978638","heartbeat_back_addr":"10.20.193.134:6807/2922978638","heartbeat_front_addr":"10.20.193.134:6805/2922978638","state":["exists","up"]},{"osd":2,"uuid":"6f3ebd5b-92a4-4b56-b83b-1ef57483f823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6800","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6801","nonce":28326527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6802","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6803","nonce":28326527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6806","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6807","nonce":28326527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6804","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6805","nonce":28326527}]},"public_addr":"10.20.193.187:6801/28326527","cluster_addr":"10.20.193.187:6803/28326527","heartbeat_back_addr":"10.20.193.187:6807/28326527","heartbeat_front_addr":"10.20.193.187:6805/28326527","state":["exists","up"]},{"osd":3,"uuid":"f8c87696-e524-441f-b262-8f1b1b088b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6811","nonce":3039326126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6813","nonce":3039326126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6817","nonce":3039326126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6815","nonce":3039326126}]},"public_addr":"10.20.193.28:6811/3039326126","cluster_addr":"10.20.193.28:6813/3039326126","heartbeat_back_addr":"10.20.193.28:6817/3039326126","heartbeat_front_addr":"10.20.193.28:6815/3039326126","state":["exists","up"]},{"osd":4,"uuid":"181c4948-a9b0-4bf5-bb9a-5071865e44ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6808","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6809","nonce":2852482005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6810","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6811","nonce":2852482005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6814","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6815","nonce":2852482005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6812","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6813","nonce":2852482005}]},"public_addr":"10.20.193.134:6809/2852482005","cluster_addr":"10.20.193.134:6811/2852482005","heartbeat_back_addr":"10.20.193.134:6815/2852482005","heartbeat_front_addr":"10.20.193.134:6813/2852482005","state":["exists","up"]},{"osd":5,"uuid":"05fa2cf3-9b55-4589-9db7-f7f20c478be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6808","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6809","nonce":3424321792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6810","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6811","nonce":3424321792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6814","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6815","nonce":3424321792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6812","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6813","nonce":3424321792}]},"public_addr":"10.20.193.187:6809/3424321792","cluster_addr":"10.20.193.187:6811/3424321792","heartbeat_back_addr":"10.20.193.187:6815/3424321792","heartbeat_front_addr":"10.20.193.187:6813/3424321792","state":["exists","up"]},{"osd":6,"uuid":"7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6819","nonce":2743891845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6821","nonce":2743891845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6825","nonce":2743891845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6823","nonce":2743891845}]},"public_addr":"10.20.193.28:6819/2743891845","cluster_addr":"10.20.193.28:6821/2743891845","heartbeat_back_addr":"10.20.193.28:6825/2743891845","heartbeat_front_addr":"10.20.193.28:6823/2743891845","state":["exists","up"]},{"osd":7,"uuid":"83f5f6ed-fa57-4628-bcf0-49d51edea60d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6816","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6817","nonce":55376257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6818","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6819","nonce":55376257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6822","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6823","nonce":55376257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6820","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6821","nonce":55376257}]},"public_addr":"10.20.193.134:6817/55376257","cluster_addr":"10.20.193.134:6819/55376257","heartbeat_back_addr":"10.20.193.134:6823/55376257","heartbeat_front_addr":"10.20.193.134:6821/55376257","state":["exists","up"]},{"osd":8,"uuid":"63963560-6c24-4627-aade-6d99ec304b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6816","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6817","nonce":2802029994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6818","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6819","nonce":2802029994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6822","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6823","nonce":2802029994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6820","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6821","nonce":2802029994}]},"public_addr":"10.20.193.187:6817/2802029994","cluster_addr":"10.20.193.187:6819/2802029994","heartbeat_back_addr":"10.20.193.187:6823/2802029994","heartbeat_front_addr":"10.20.193.187:6821/2802029994","state":["exists","up"]},{"osd":9,"uuid":"184bf253-88c2-45c2-a17b-e1d06b4b1985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6827","nonce":1895700373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6829","nonce":1895700373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6833","nonce":1895700373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6831","nonce":1895700373}]},"public_addr":"10.20.193.28:6827/1895700373","cluster_addr":"10.20.193.28:6829/1895700373","heartbeat_back_addr":"10.20.193.28:6833/1895700373","heartbeat_front_addr":"10.20.193.28:6831/1895700373","state":["exists","up"]},{"osd":10,"uuid":"d23958fb-8b6d-4d42-9a41-d55ea62f4328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6824","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6825","nonce":1465401365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6826","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6827","nonce":1465401365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6830","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6831","nonce":1465401365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6828","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6829","nonce":1465401365}]},"public_addr":"10.20.193.134:6825/1465401365","cluster_addr":"10.20.193.134:6827/1465401365","heartbeat_back_addr":"10.20.193.134:6831/1465401365","heartbeat_front_addr":"10.20.193.134:6829/1465401365","state":["exists","up"]},{"osd":11,"uuid":"49d3cb86-161d-4c61-af51-58a293ae6948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6824","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6825","nonce":3880817278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6826","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6827","nonce":3880817278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6830","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6831","nonce":3880817278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6828","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6829","nonce":3880817278}]},"public_addr":"10.20.193.187:6825/3880817278","cluster_addr":"10.20.193.187:6827/3880817278","heartbeat_back_addr":"10.20.193.187:6831/3880817278","heartbeat_front_addr":"10.20.193.187:6829/3880817278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.844101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:48.399902+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.304413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:06.142985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:13.695054+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:20.759285+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.814864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:39.345155+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.698150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:58.098934+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:05.932878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:13.217409+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/2396565153":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/2466054030":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/4240498935":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6801/4264511310":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6800/4264511310":"2026-02-14T01:22:50.011933+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:36.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6ee40b5680 msgr2=0x7f6ee40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6ee40b5680 0x7f6ee40d5b30 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f0c0fb300 tx=0x7f6ef40023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 msgr2=0x7f6f0c0f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 0x7f6f0c0f49c0 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f0000ba30 tx=0x7f6f0000bf00 comp rx=0 tx=0).stop 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 shutdown_connections 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f6ee40b5680 0x7f6ee40d5b30 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6f0c0f4ff0 0x7f6f0c0fa270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6f0c115270 0x7f6f0c175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 --2- 10.20.193.28:0/680412705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f0c10f060 0x7f6f0c0f49c0 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 >> 10.20.193.28:0/680412705 conn(0x7f6f0c0ec980 msgr2=0x7f6f0c10d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 shutdown_connections 2026-02-13T01:25:36.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:36.747+0000 7f6f0b5776c0 1 -- 10.20.193.28:0/680412705 wait complete. 2026-02-13T01:25:36.849 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:37.033 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:37.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1293563671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c010fa50 msgr2=0x7f33c0114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 --2- 10.20.193.28:0/1293563671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c010fa50 0x7f33c0114a90 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=1703796249043108199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33b00099a0 tx=0x7f33b002ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:37.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1293563671 shutdown_connections 2026-02-13T01:25:37.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 --2- 10.20.193.28:0/1293563671 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f33c0115270 0x7f33c0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 --2- 10.20.193.28:0/1293563671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c010fa50 0x7f33c0114a90 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=1703796249043108199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 --2- 10.20.193.28:0/1293563671 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f33c010f060 0x7f33c010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1293563671 >> 10.20.193.28:0/1293563671 conn(0x7f33c00ec980 msgr2=0x7f33c010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:37.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1293563671 shutdown_connections 2026-02-13T01:25:37.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1293563671 wait complete. 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.223+0000 7f33c48db6c0 1 Processor -- start 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 -- start start 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f33c010f060 0x7f33c00f4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 0x7f33c0175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f33c00f50e0 0x7f33c00fa360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00f57d0 con 0x7f33c0115270 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00fa8a0 con 0x7f33c00f50e0 2026-02-13T01:25:37.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33c48db6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00faa60 con 0x7f33c010f060 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 0x7f33c0175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 0x7f33c0175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34444/0 (socket says 10.20.193.28:34444) 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 -- 10.20.193.28:0/1396164245 learned_addr learned my addr 10.20.193.28:0/1396164245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33bffff6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f33c00f50e0 0x7f33c00fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33bf7fe6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f33c010f060 0x7f33c00f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 -- 10.20.193.28:0/1396164245 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f33c010f060 msgr2=0x7f33c00f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f33c010f060 0x7f33c00f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 -- 10.20.193.28:0/1396164245 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f33c00f50e0 msgr2=0x7f33c00fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f33c00f50e0 0x7f33c00fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.224+0000 7f33beffd6c0 1 -- 10.20.193.28:0/1396164245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b0009590 con 0x7f33c0115270 2026-02-13T01:25:37.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f33beffd6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 0x7f33c0175b10 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33b002f210 tx=0x7f33b002fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33b0002ae0 con 0x7f33c0115270 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f33b0002c40 con 0x7f33c0115270 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33b00372f0 con 0x7f33c0115270 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1396164245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c00face0 con 0x7f33c0115270 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f33c48db6c0 1 -- 10.20.193.28:0/1396164245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c00fb110 con 0x7f33c0115270 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.225+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c0110330 con 0x7f33c0115270 2026-02-13T01:25:37.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.228+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f33b0007260 con 0x7f33c0115270 2026-02-13T01:25:37.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.230+0000 7f33bcff96c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33940b5680 0x7f33940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.230+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f33b0107a50 con 0x7f33c0115270 2026-02-13T01:25:37.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.230+0000 7f33bf7fe6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33940b5680 0x7f33940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.230+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f33b01405e0 con 0x7f33c0115270 2026-02-13T01:25:37.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.230+0000 7f33bf7fe6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33940b5680 0x7f33940d5b30 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33ac005980 tx=0x7f33ac005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:37.330 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:37 trial028 ceph-mon[22984]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:25:37.331 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:37 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:25:37.331 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:37 trial028 ceph-mon[22984]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2026-02-13T01:25:37.331 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:37 trial028 ceph-mon[22984]: daemon mds.i is now active in filesystem cephfs as rank 0 2026-02-13T01:25:37.331 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:37 trial028 ceph-mon[22984]: pgmap v195: 97 pgs: 7 active+clean, 14 creating+peering, 76 unknown; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:37.331 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:37 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/680412705' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:37.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.330+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33c010f430 con 0x7f33c0115270 2026-02-13T01:25:37.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.330+0000 7f33bcff96c0 1 -- 10.20.193.28:0/1396164245 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22038 (secure 0 0 0) 0x7f33b00ca5d0 con 0x7f33c0115270 2026-02-13T01:25:37.333 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:37.333 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":75,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","created":"2026-02-13T01:22:41.806447+0000","modified":"2026-02-13T01:25:37.132531+0000","last_up_change":"2026-02-13T01:25:14.875697+0000","last_in_change":"2026-02-13T01:25:06.785151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:58.205191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:33.235628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:34.724553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b609cc73-d28a-4ba8-9724-13ee6cc98de8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6803","nonce":2961143377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6805","nonce":2961143377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6809","nonce":2961143377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6807","nonce":2961143377}]},"public_addr":"10.20.193.28:6803/2961143377","cluster_addr":"10.20.193.28:6805/2961143377","heartbeat_back_addr":"10.20.193.28:6809/2961143377","heartbeat_front_addr":"10.20.193.28:6807/2961143377","state":["exists","up"]},{"osd":1,"uuid":"8b21607c-6340-49b2-ae85-eb92729919c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6800","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6801","nonce":2922978638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6802","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6803","nonce":2922978638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6806","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6807","nonce":2922978638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6804","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6805","nonce":2922978638}]},"public_addr":"10.20.193.134:6801/2922978638","cluster_addr":"10.20.193.134:6803/2922978638","heartbeat_back_addr":"10.20.193.134:6807/2922978638","heartbeat_front_addr":"10.20.193.134:6805/2922978638","state":["exists","up"]},{"osd":2,"uuid":"6f3ebd5b-92a4-4b56-b83b-1ef57483f823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6800","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6801","nonce":28326527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6802","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6803","nonce":28326527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6806","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6807","nonce":28326527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6804","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6805","nonce":28326527}]},"public_addr":"10.20.193.187:6801/28326527","cluster_addr":"10.20.193.187:6803/28326527","heartbeat_back_addr":"10.20.193.187:6807/28326527","heartbeat_front_addr":"10.20.193.187:6805/28326527","state":["exists","up"]},{"osd":3,"uuid":"f8c87696-e524-441f-b262-8f1b1b088b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6811","nonce":3039326126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6813","nonce":3039326126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6817","nonce":3039326126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6815","nonce":3039326126}]},"public_addr":"10.20.193.28:6811/3039326126","cluster_addr":"10.20.193.28:6813/3039326126","heartbeat_back_addr":"10.20.193.28:6817/3039326126","heartbeat_front_addr":"10.20.193.28:6815/3039326126","state":["exists","up"]},{"osd":4,"uuid":"181c4948-a9b0-4bf5-bb9a-5071865e44ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6808","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6809","nonce":2852482005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6810","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6811","nonce":2852482005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6814","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6815","nonce":2852482005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6812","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6813","nonce":2852482005}]},"public_addr":"10.20.193.134:6809/2852482005","cluster_addr":"10.20.193.134:6811/2852482005","heartbeat_back_addr":"10.20.193.134:6815/2852482005","heartbeat_front_addr":"10.20.193.134:6813/2852482005","state":["exists","up"]},{"osd":5,"uuid":"05fa2cf3-9b55-4589-9db7-f7f20c478be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6808","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6809","nonce":3424321792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6810","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6811","nonce":3424321792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6814","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6815","nonce":3424321792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6812","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6813","nonce":3424321792}]},"public_addr":"10.20.193.187:6809/3424321792","cluster_addr":"10.20.193.187:6811/3424321792","heartbeat_back_addr":"10.20.193.187:6815/3424321792","heartbeat_front_addr":"10.20.193.187:6813/3424321792","state":["exists","up"]},{"osd":6,"uuid":"7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6819","nonce":2743891845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6821","nonce":2743891845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6825","nonce":2743891845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6823","nonce":2743891845}]},"public_addr":"10.20.193.28:6819/2743891845","cluster_addr":"10.20.193.28:6821/2743891845","heartbeat_back_addr":"10.20.193.28:6825/2743891845","heartbeat_front_addr":"10.20.193.28:6823/2743891845","state":["exists","up"]},{"osd":7,"uuid":"83f5f6ed-fa57-4628-bcf0-49d51edea60d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6816","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6817","nonce":55376257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6818","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6819","nonce":55376257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6822","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6823","nonce":55376257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6820","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6821","nonce":55376257}]},"public_addr":"10.20.193.134:6817/55376257","cluster_addr":"10.20.193.134:6819/55376257","heartbeat_back_addr":"10.20.193.134:6823/55376257","heartbeat_front_addr":"10.20.193.134:6821/55376257","state":["exists","up"]},{"osd":8,"uuid":"63963560-6c24-4627-aade-6d99ec304b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6816","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6817","nonce":2802029994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6818","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6819","nonce":2802029994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6822","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6823","nonce":2802029994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6820","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6821","nonce":2802029994}]},"public_addr":"10.20.193.187:6817/2802029994","cluster_addr":"10.20.193.187:6819/2802029994","heartbeat_back_addr":"10.20.193.187:6823/2802029994","heartbeat_front_addr":"10.20.193.187:6821/2802029994","state":["exists","up"]},{"osd":9,"uuid":"184bf253-88c2-45c2-a17b-e1d06b4b1985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6827","nonce":1895700373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6829","nonce":1895700373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6833","nonce":1895700373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6831","nonce":1895700373}]},"public_addr":"10.20.193.28:6827/1895700373","cluster_addr":"10.20.193.28:6829/1895700373","heartbeat_back_addr":"10.20.193.28:6833/1895700373","heartbeat_front_addr":"10.20.193.28:6831/1895700373","state":["exists","up"]},{"osd":10,"uuid":"d23958fb-8b6d-4d42-9a41-d55ea62f4328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6824","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6825","nonce":1465401365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6826","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6827","nonce":1465401365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6830","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6831","nonce":1465401365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6828","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6829","nonce":1465401365}]},"public_addr":"10.20.193.134:6825/1465401365","cluster_addr":"10.20.193.134:6827/1465401365","heartbeat_back_addr":"10.20.193.134:6831/1465401365","heartbeat_front_addr":"10.20.193.134:6829/1465401365","state":["exists","up"]},{"osd":11,"uuid":"49d3cb86-161d-4c61-af51-58a293ae6948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6824","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6825","nonce":3880817278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6826","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6827","nonce":3880817278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6830","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6831","nonce":3880817278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6828","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6829","nonce":3880817278}]},"public_addr":"10.20.193.187:6825/3880817278","cluster_addr":"10.20.193.187:6827/3880817278","heartbeat_back_addr":"10.20.193.187:6831/3880817278","heartbeat_front_addr":"10.20.193.187:6829/3880817278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.844101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:48.399902+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.304413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:06.142985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:13.695054+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:20.759285+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.814864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:39.345155+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.698150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:58.098934+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:05.932878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:13.217409+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/2396565153":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/2466054030":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/4240498935":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6801/4264511310":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6800/4264511310":"2026-02-14T01:22:50.011933+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33940b5680 msgr2=0x7f33940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33940b5680 0x7f33940d5b30 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33ac005980 tx=0x7f33ac005910 comp rx=0 tx=0).stop 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 msgr2=0x7f33c0175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 0x7f33c0175b10 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33b002f210 tx=0x7f33b002fc60 comp rx=0 tx=0).stop 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 shutdown_connections 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f33c00f50e0 0x7f33c00fa360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33c0115270 0x7f33c0175b10 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f33940b5680 0x7f33940d5b30 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 --2- 10.20.193.28:0/1396164245 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f33c010f060 0x7f33c00f4ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 >> 10.20.193.28:0/1396164245 conn(0x7f33c00ec980 msgr2=0x7f33c010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:37.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 shutdown_connections 2026-02-13T01:25:37.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.332+0000 7f339a7fc6c0 1 -- 10.20.193.28:0/1396164245 wait complete. 2026-02-13T01:25:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:37 trial187 ceph-mon[27464]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:25:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:37 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:25:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:37 trial187 ceph-mon[27464]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2026-02-13T01:25:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:37 trial187 ceph-mon[27464]: daemon mds.i is now active in filesystem cephfs as rank 0 2026-02-13T01:25:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:37 trial187 ceph-mon[27464]: pgmap v195: 97 pgs: 7 active+clean, 14 creating+peering, 76 unknown; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:37 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/680412705' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:37.436 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T01:25:37.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:37 trial134 ceph-mon[27948]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:25:37.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:37 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:25:37.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:37 trial134 ceph-mon[27948]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2026-02-13T01:25:37.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:37 trial134 ceph-mon[27948]: daemon mds.i is now active in filesystem cephfs as rank 0 2026-02-13T01:25:37.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:37 trial134 ceph-mon[27948]: pgmap v195: 97 pgs: 7 active+clean, 14 creating+peering, 76 unknown; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:37.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:37 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/680412705' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:37.622 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:37.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 -- 10.20.193.28:0/2060816574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d410f060 msgr2=0x7f32d410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/2060816574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d410f060 0x7f32d410f430 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=18071847603072593339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32c80098d0 tx=0x7f32c802ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 -- 10.20.193.28:0/2060816574 shutdown_connections 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/2060816574 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d4115270 0x7f32d4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/2060816574 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f32d410fa50 0x7f32d4114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/2060816574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d410f060 0x7f32d410f430 unknown :-1 s=CLOSED pgs=177 gs=2 cs=0 l=1 c_cookie=18071847603072593339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 -- 10.20.193.28:0/2060816574 >> 10.20.193.28:0/2060816574 conn(0x7f32d40ec980 msgr2=0x7f32d410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 -- 10.20.193.28:0/2060816574 shutdown_connections 2026-02-13T01:25:37.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.821+0000 7f32d880f6c0 1 -- 10.20.193.28:0/2060816574 wait complete. 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 Processor -- start 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 -- start start 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d410f060 0x7f32d411d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f32d4115270 0x7f32d411d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d41229b0 0x7f32d4122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41233c0 con 0x7f32d41229b0 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4123530 con 0x7f32d4115270 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d880f6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41236f0 con 0x7f32d410f060 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d2d766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d410f060 0x7f32d411d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d2d766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d410f060 0x7f32d411d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:55188/0 (socket says 10.20.193.28:55188) 2026-02-13T01:25:37.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d2d766c0 1 -- 10.20.193.28:0/151346052 learned_addr learned my addr 10.20.193.28:0/151346052 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d35776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d41229b0 0x7f32d4122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d25756c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f32d4115270 0x7f32d411d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d35776c0 1 -- 10.20.193.28:0/151346052 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d410f060 msgr2=0x7f32d411d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d35776c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d410f060 0x7f32d411d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d35776c0 1 -- 10.20.193.28:0/151346052 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f32d4115270 msgr2=0x7f32d411d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d35776c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f32d4115270 0x7f32d411d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.822+0000 7f32d35776c0 1 -- 10.20.193.28:0/151346052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c80094c0 con 0x7f32d41229b0 2026-02-13T01:25:37.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32d35776c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d41229b0 0x7f32d4122e50 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32c400c6c0 tx=0x7f32c400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:37.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32c4005340 con 0x7f32d41229b0 2026-02-13T01:25:37.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f32c4003cf0 con 0x7f32d41229b0 2026-02-13T01:25:37.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32c400dd30 con 0x7f32d41229b0 2026-02-13T01:25:37.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d4163ba0 con 0x7f32d41229b0 2026-02-13T01:25:37.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d4164030 con 0x7f32d41229b0 2026-02-13T01:25:37.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.823+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d4110330 con 0x7f32d41229b0 2026-02-13T01:25:37.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.826+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f32c4003810 con 0x7f32d41229b0 2026-02-13T01:25:37.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.827+0000 7f32b3fff6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f32a80b5680 0x7f32a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:37.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.828+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f32c40e4820 con 0x7f32d41229b0 2026-02-13T01:25:37.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.828+0000 7f32d2d766c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f32a80b5680 0x7f32a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:37.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.828+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f32c40e4ca0 con 0x7f32d41229b0 2026-02-13T01:25:37.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.828+0000 7f32d2d766c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f32a80b5680 0x7f32a80d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32c80097f0 tx=0x7f32c8031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:37.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:37.951+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f32d410f430 con 0x7f32d41229b0 2026-02-13T01:25:38.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.141+0000 7f32b3fff6c0 1 -- 10.20.193.28:0/151346052 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f32c40a73a0 con 0x7f32d41229b0 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f32a80b5680 msgr2=0x7f32a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f32a80b5680 0x7f32a80d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32c80097f0 tx=0x7f32c8031f90 comp rx=0 tx=0).stop 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d41229b0 msgr2=0x7f32d4122e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d41229b0 0x7f32d4122e50 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32c400c6c0 tx=0x7f32c400cb90 comp rx=0 tx=0).stop 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 shutdown_connections 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32d41229b0 0x7f32d4122e50 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f32d4115270 0x7f32d411d5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f32a80b5680 0x7f32a80d5b30 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 --2- 10.20.193.28:0/151346052 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f32d410f060 0x7f32d411d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 >> 10.20.193.28:0/151346052 conn(0x7f32d40ec980 msgr2=0x7f32d410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:38.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 shutdown_connections 2026-02-13T01:25:38.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.143+0000 7f32d880f6c0 1 -- 10.20.193.28:0/151346052 wait complete. 2026-02-13T01:25:38.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:38 trial028 ceph-mon[22984]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:25:38.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:38 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.187:6838/2636275695,v1:10.20.193.187:6839/2636275695] up:active 2026-02-13T01:25:38.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:38 trial028 ceph-mon[22984]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:38.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:38 trial028 ceph-mon[22984]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:38.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:38 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1396164245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:38.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:38 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/151346052' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:25:38.244 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-13T01:25:38.244 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-13T01:25:38.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:38 trial187 ceph-mon[27464]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:25:38.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:38 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.187:6838/2636275695,v1:10.20.193.187:6839/2636275695] up:active 2026-02-13T01:25:38.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:38 trial187 ceph-mon[27464]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:38.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:38 trial187 ceph-mon[27464]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:38.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:38 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1396164245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:38.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:38 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/151346052' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:25:38.429 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:38.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:38 trial134 ceph-mon[27948]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:25:38.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:38 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.187:6838/2636275695,v1:10.20.193.187:6839/2636275695] up:active 2026-02-13T01:25:38.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:38 trial134 ceph-mon[27948]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:38.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:38 trial134 ceph-mon[27948]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:38.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:38 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1396164245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:38.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:38 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/151346052' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 -- 10.20.193.28:0/3123521083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 msgr2=0x7f143c11b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/3123521083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c11b7c0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=2498448673030575050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14300098a0 tx=0x7f143002ec50 comp rx=0 tx=0).stop 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 -- 10.20.193.28:0/3123521083 shutdown_connections 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/3123521083 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c1199a0 0x7f143c116df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/3123521083 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f143c118f30 0x7f143c119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/3123521083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c11b7c0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=2498448673030575050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 -- 10.20.193.28:0/3123521083 >> 10.20.193.28:0/3123521083 conn(0x7f143c05b290 msgr2=0x7f143c05b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:38.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 -- 10.20.193.28:0/3123521083 shutdown_connections 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.621+0000 7f143bfff6c0 1 -- 10.20.193.28:0/3123521083 wait complete. 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 Processor -- start 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 -- start start 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c118f30 0x7f143c0fdcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f143c1199a0 0x7f143c0fe1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c1035b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f143c103c00 con 0x7f143c11b3f0 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f143c103d70 con 0x7f143c1199a0 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.622+0000 7f143bfff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f143c103f30 con 0x7f143c118f30 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c118f30 0x7f143c0fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143b7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c1035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143b7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c1035b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34476/0 (socket says 10.20.193.28:34476) 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143b7fe6c0 1 -- 10.20.193.28:0/602955071 learned_addr learned my addr 10.20.193.28:0/602955071 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143a7fc6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f143c1199a0 0x7f143c0fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 -- 10.20.193.28:0/602955071 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f143c1199a0 msgr2=0x7f143c0fe1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f143c1199a0 0x7f143c0fe1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 -- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 msgr2=0x7f143c1035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c1035b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 -- 10.20.193.28:0/602955071 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14300094c0 con 0x7f143c118f30 2026-02-13T01:25:38.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143b7fe6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c1035b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:38.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.623+0000 7f143affd6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c118f30 0x7f143c0fdcb0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14300097f0 tx=0x7f143002fbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.624+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1430002ae0 con 0x7f143c118f30 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.624+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1430002c40 con 0x7f143c118f30 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.624+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14300362f0 con 0x7f143c118f30 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.624+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c1041b0 con 0x7f143c118f30 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.624+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c1048d0 con 0x7f143c118f30 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.624+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c05e670 con 0x7f143c118f30 2026-02-13T01:25:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.626+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f14300071c0 con 0x7f143c118f30 2026-02-13T01:25:38.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.628+0000 7f141bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f140c0b5680 0x7f140c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.628+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f14301078e0 con 0x7f143c118f30 2026-02-13T01:25:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.628+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1430107d60 con 0x7f143c118f30 2026-02-13T01:25:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.628+0000 7f143a7fc6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f140c0b5680 0x7f140c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.629+0000 7f143a7fc6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f140c0b5680 0x7f140c0d5b30 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f143c104640 tx=0x7f1424009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:38.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.753+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7f143c0fee00 con 0x7f143c118f30 2026-02-13T01:25:38.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.858+0000 7f141bfff6c0 1 -- 10.20.193.28:0/602955071 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7f14300ca460 con 0x7f143c118f30 2026-02-13T01:25:38.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f140c0b5680 msgr2=0x7f140c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f140c0b5680 0x7f140c0d5b30 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f143c104640 tx=0x7f1424009310 comp rx=0 tx=0).stop 2026-02-13T01:25:38.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c118f30 msgr2=0x7f143c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c118f30 0x7f143c0fdcb0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14300097f0 tx=0x7f143002fbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 shutdown_connections 2026-02-13T01:25:38.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f143c11b3f0 0x7f143c1035b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f143c1199a0 0x7f143c0fe1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f140c0b5680 0x7f140c0d5b30 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 --2- 10.20.193.28:0/602955071 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f143c118f30 0x7f143c0fdcb0 unknown :-1 s=CLOSED pgs=77 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 >> 10.20.193.28:0/602955071 conn(0x7f143c05b290 msgr2=0x7f143c0f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:38.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 shutdown_connections 2026-02-13T01:25:38.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:38.860+0000 7f143bfff6c0 1 -- 10.20.193.28:0/602955071 wait complete. 2026-02-13T01:25:38.965 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T01:25:39.147 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:39.266 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/151346052' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:25:39.266 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:39.266 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: pgmap v197: 97 pgs: 49 active+clean, 14 creating+peering, 34 unknown; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s wr, 6 op/s 2026-02-13T01:25:39.266 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:39.266 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/602955071' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:39.267 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:25:39.267 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:25:39.267 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:25:39.267 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2026-02-13T01:25:39.267 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:39 trial028 ceph-mon[22984]: daemon mds.b is now active in filesystem cephfs as rank 1 2026-02-13T01:25:39.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 -- 10.20.193.28:0/2381320043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f385810fa50 msgr2=0x7f3858114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 --2- 10.20.193.28:0/2381320043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f385810fa50 0x7f3858114a90 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=9757881040581034304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f384c0099a0 tx=0x7f384c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 -- 10.20.193.28:0/2381320043 shutdown_connections 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 --2- 10.20.193.28:0/2381320043 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3858115270 0x7f3858175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 --2- 10.20.193.28:0/2381320043 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f385810fa50 0x7f3858114a90 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=9757881040581034304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 --2- 10.20.193.28:0/2381320043 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 0x7f385810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 -- 10.20.193.28:0/2381320043 >> 10.20.193.28:0/2381320043 conn(0x7f38580ec980 msgr2=0x7f385810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 -- 10.20.193.28:0/2381320043 shutdown_connections 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.360+0000 7f385e8036c0 1 -- 10.20.193.28:0/2381320043 wait complete. 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 Processor -- start 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 -- start start 2026-02-13T01:25:39.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 0x7f38580f4a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3858115270 0x7f3858175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38580f50b0 0x7f38580fa380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38580f57a0 con 0x7f38580f50b0 2026-02-13T01:25:39.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38580fa8c0 con 0x7f385810f060 2026-02-13T01:25:39.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.361+0000 7f385e8036c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f38580faa80 con 0x7f3858115270 2026-02-13T01:25:39.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385d8016c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 0x7f38580f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385d0006c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3858115270 0x7f3858175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38580f50b0 0x7f38580fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385d8016c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 0x7f38580f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:60746/0 (socket says 10.20.193.28:60746) 2026-02-13T01:25:39.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385d8016c0 1 -- 10.20.193.28:0/3235687908 learned_addr learned my addr 10.20.193.28:0/3235687908 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 -- 10.20.193.28:0/3235687908 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3858115270 msgr2=0x7f3858175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3858115270 0x7f3858175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 -- 10.20.193.28:0/3235687908 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 msgr2=0x7f38580f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 0x7f38580f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 -- 10.20.193.28:0/3235687908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c009590 con 0x7f38580f50b0 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e0026c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38580f50b0 0x7f38580fa380 secure :-1 s=READY pgs=181 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3854006fd0 tx=0x7f385400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3854003c40 con 0x7f38580f50b0 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f385400a070 con 0x7f38580f50b0 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f385400dd50 con 0x7f38580f50b0 2026-02-13T01:25:39.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38580fad60 con 0x7f38580f50b0 2026-02-13T01:25:39.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.362+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38580fb1f0 con 0x7f38580f50b0 2026-02-13T01:25:39.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.363+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3858110330 con 0x7f38580f50b0 2026-02-13T01:25:39.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.365+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f3854005030 con 0x7f38580f50b0 2026-02-13T01:25:39.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.367+0000 7f38467fc6c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38340b5680 0x7f38340d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:39.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.367+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f38540e45b0 con 0x7f38580f50b0 2026-02-13T01:25:39.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.367+0000 7f385d8016c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38340b5680 0x7f38340d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:39.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.367+0000 7f385d8016c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38340b5680 0x7f38340d5b30 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3848005c80 tx=0x7f38480094c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:39.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.368+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38540a7130 con 0x7f38580f50b0 2026-02-13T01:25:39.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.492+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f385810f430 con 0x7f38580f50b0 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/151346052' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: pgmap v197: 97 pgs: 49 active+clean, 14 creating+peering, 34 unknown; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s wr, 6 op/s 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/602955071' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:25:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:25:39.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2026-02-13T01:25:39.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:39 trial134 ceph-mon[27948]: daemon mds.b is now active in filesystem cephfs as rank 1 2026-02-13T01:25:39.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/151346052' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:25:39.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-13T01:25:39.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: pgmap v197: 97 pgs: 49 active+clean, 14 creating+peering, 34 unknown; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s wr, 6 op/s 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/602955071' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2026-02-13T01:25:39.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:39 trial187 ceph-mon[27464]: daemon mds.b is now active in filesystem cephfs as rank 1 2026-02-13T01:25:39.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.858+0000 7f38467fc6c0 1 -- 10.20.193.28:0/3235687908 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f38540aa2e0 con 0x7f38580f50b0 2026-02-13T01:25:39.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38340b5680 msgr2=0x7f38340d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38340b5680 0x7f38340d5b30 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3848005c80 tx=0x7f38480094c0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38580f50b0 msgr2=0x7f38580fa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38580f50b0 0x7f38580fa380 secure :-1 s=READY pgs=181 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3854006fd0 tx=0x7f385400cbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 shutdown_connections 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38340b5680 0x7f38340d5b30 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3858115270 0x7f3858175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38580f50b0 0x7f38580fa380 unknown :-1 s=CLOSED pgs=181 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 --2- 10.20.193.28:0/3235687908 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f385810f060 0x7f38580f4a80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:39.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.860+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 >> 10.20.193.28:0/3235687908 conn(0x7f38580ec980 msgr2=0x7f385810d640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:39.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.862+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 shutdown_connections 2026-02-13T01:25:39.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:39.862+0000 7f385e8036c0 1 -- 10.20.193.28:0/3235687908 wait complete. 2026-02-13T01:25:39.967 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T01:25:40.149 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:40.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.357+0000 7f964d7f76c0 1 -- 10.20.193.28:0/2511012811 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 msgr2=0x7f9648114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:40.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.357+0000 7f964d7f76c0 1 --2- 10.20.193.28:0/2511012811 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 0x7f9648114ee0 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=2220050124517316324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f963800aa40 tx=0x7f963802fdf0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 -- 10.20.193.28:0/2511012811 shutdown_connections 2026-02-13T01:25:40.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 --2- 10.20.193.28:0/2511012811 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 0x7f9648114ee0 unknown :-1 s=CLOSED pgs=72 gs=2 cs=0 l=1 c_cookie=2220050124517316324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 --2- 10.20.193.28:0/2511012811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9648113dc0 0x7f9648114210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 --2- 10.20.193.28:0/2511012811 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f964811b510 0x7f964811b8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 -- 10.20.193.28:0/2511012811 >> 10.20.193.28:0/2511012811 conn(0x7f9648058a50 msgr2=0x7f9648058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:40.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 -- 10.20.193.28:0/2511012811 shutdown_connections 2026-02-13T01:25:40.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 -- 10.20.193.28:0/2511012811 wait complete. 2026-02-13T01:25:40.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.358+0000 7f964d7f76c0 1 Processor -- start 2026-02-13T01:25:40.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 -- start start 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9648113dc0 0x7f964812b770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 0x7f964812bcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 0x7f9648131070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96481316c0 con 0x7f964811b510 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9648131830 con 0x7f96481149c0 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f964d7f76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f96481319f0 con 0x7f9648113dc0 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f96477fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 0x7f9648131070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:40.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f9646ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9648113dc0 0x7f964812b770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f96467fc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 0x7f964812bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f96477fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 0x7f9648131070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34510/0 (socket says 10.20.193.28:34510) 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.359+0000 7f96477fe6c0 1 -- 10.20.193.28:0/3918585767 learned_addr learned my addr 10.20.193.28:0/3918585767 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f96477fe6c0 1 -- 10.20.193.28:0/3918585767 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9648113dc0 msgr2=0x7f964812b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f96477fe6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9648113dc0 0x7f964812b770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f96477fe6c0 1 -- 10.20.193.28:0/3918585767 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 msgr2=0x7f964812bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f96477fe6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 0x7f964812bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f96477fe6c0 1 -- 10.20.193.28:0/3918585767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963800a660 con 0x7f964811b510 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f96477fe6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 0x7f9648131070 secure :-1 s=READY pgs=182 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96380054b0 tx=0x7f96380054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9638030d80 con 0x7f964811b510 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f964d7f76c0 1 -- 10.20.193.28:0/3918585767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9648131c70 con 0x7f964811b510 2026-02-13T01:25:40.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96380309a0 con 0x7f964811b510 2026-02-13T01:25:40.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96380328c0 con 0x7f964811b510 2026-02-13T01:25:40.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.360+0000 7f964d7f76c0 1 -- 10.20.193.28:0/3918585767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96481723b0 con 0x7f964811b510 2026-02-13T01:25:40.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.361+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9610005310 con 0x7f964811b510 2026-02-13T01:25:40.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.363+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f9638032030 con 0x7f964811b510 2026-02-13T01:25:40.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.365+0000 7f9627fff6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f961c0b5680 0x7f961c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:40.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.365+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f9638108b70 con 0x7f964811b510 2026-02-13T01:25:40.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.365+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f96381415e0 con 0x7f964811b510 2026-02-13T01:25:40.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.365+0000 7f9646ffd6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f961c0b5680 0x7f961c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:40.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.365+0000 7f9646ffd6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f961c0b5680 0x7f961c0d5b30 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f963c004750 tx=0x7f963c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3235687908' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3235687908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.134:6838/522432871,v1:10.20.193.134:6839/522432871] up:active 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2026-02-13T01:25:40.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2026-02-13T01:25:40.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:40 trial028 ceph-mon[22984]: daemon mds.c is now active in filesystem cephfs as rank 2 2026-02-13T01:25:40.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.489+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9610005960 con 0x7f964811b510 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3235687908' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3235687908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.134:6838/522432871,v1:10.20.193.134:6839/522432871] up:active 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2026-02-13T01:25:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:40 trial134 ceph-mon[27948]: daemon mds.c is now active in filesystem cephfs as rank 2 2026-02-13T01:25:40.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3235687908' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:25:40.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3235687908' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:25:40.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.134:6838/522432871,v1:10.20.193.134:6839/522432871] up:active 2026-02-13T01:25:40.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:25:40.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:25:40.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2026-02-13T01:25:40.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2026-02-13T01:25:40.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:40 trial187 ceph-mon[27464]: daemon mds.c is now active in filesystem cephfs as rank 2 2026-02-13T01:25:40.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.865+0000 7f9627fff6c0 1 -- 10.20.193.28:0/3918585767 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f96380cb6f0 con 0x7f964811b510 2026-02-13T01:25:40.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.866+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f961c0b5680 msgr2=0x7f961c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:40.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.866+0000 7f9625ffb6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f961c0b5680 0x7f961c0d5b30 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f963c004750 tx=0x7f963c009260 comp rx=0 tx=0).stop 2026-02-13T01:25:40.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.866+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 msgr2=0x7f9648131070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 0x7f9648131070 secure :-1 s=READY pgs=182 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96380054b0 tx=0x7f96380054e0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 shutdown_connections 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f964811b510 0x7f9648131070 unknown :-1 s=CLOSED pgs=182 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f96481149c0 0x7f964812bcb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f961c0b5680 0x7f961c0d5b30 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 --2- 10.20.193.28:0/3918585767 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9648113dc0 0x7f964812b770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 >> 10.20.193.28:0/3918585767 conn(0x7f9648058a50 msgr2=0x7f96481193b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 shutdown_connections 2026-02-13T01:25:40.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:40.867+0000 7f9625ffb6c0 1 -- 10.20.193.28:0/3918585767 wait complete. 2026-02-13T01:25:40.971 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2026-02-13T01:25:40.972 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T01:25:41.152 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:41 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3918585767' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:25:41.152 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:41 trial028 ceph-mon[22984]: pgmap v198: 97 pgs: 89 active+clean, 8 creating+peering; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s wr, 9 op/s 2026-02-13T01:25:41.152 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:41 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3918585767' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:25:41.153 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:41.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 -- 10.20.193.28:0/2054085004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc11a8a0 msgr2=0x7f52bc17b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 --2- 10.20.193.28:0/2054085004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b240 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=780374251824730526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b800aa70 tx=0x7f52b802fdd0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 -- 10.20.193.28:0/2054085004 shutdown_connections 2026-02-13T01:25:41.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 --2- 10.20.193.28:0/2054085004 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc115080 0x7f52bc11a0c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 --2- 10.20.193.28:0/2054085004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b240 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=780374251824730526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 --2- 10.20.193.28:0/2054085004 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52bc114690 0x7f52bc114a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 -- 10.20.193.28:0/2054085004 >> 10.20.193.28:0/2054085004 conn(0x7f52bc05cd60 msgr2=0x7f52bc05d160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:41.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 -- 10.20.193.28:0/2054085004 shutdown_connections 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.346+0000 7f52c22526c0 1 -- 10.20.193.28:0/2054085004 wait complete. 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 Processor -- start 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 -- start start 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52bc114690 0x7f52bc0fd4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc0fdb10 0x7f52bc102de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc0fe200 con 0x7f52bc0fdb10 2026-02-13T01:25:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc103320 con 0x7f52bc114690 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.347+0000 7f52c22526c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1034e0 con 0x7f52bc11a8a0 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:55268/0 (socket says 10.20.193.28:55268) 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 -- 10.20.193.28:0/4239495347 learned_addr learned my addr 10.20.193.28:0/4239495347 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c12506c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52bc114690 0x7f52bc0fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c1a516c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc0fdb10 0x7f52bc102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 -- 10.20.193.28:0/4239495347 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52bc114690 msgr2=0x7f52bc0fd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52bc114690 0x7f52bc0fd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 -- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc0fdb10 msgr2=0x7f52bc102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc0fdb10 0x7f52bc102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 -- 10.20.193.28:0/4239495347 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b800a660 con 0x7f52bc11a8a0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c1a516c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc0fdb10 0x7f52bc102de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c0a4f6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b140 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b000b830 tx=0x7f52b000bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52b0004a80 con 0x7f52bc11a8a0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f52b0009030 con 0x7f52bc11a8a0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52b00071c0 con 0x7f52bc11a8a0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c22526c0 1 -- 10.20.193.28:0/4239495347 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc1037c0 con 0x7f52bc11a8a0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.348+0000 7f52c22526c0 1 -- 10.20.193.28:0/4239495347 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc103f50 con 0x7f52bc11a8a0 2026-02-13T01:25:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.349+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc115960 con 0x7f52bc11a8a0 2026-02-13T01:25:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.352+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f52b0004060 con 0x7f52bc11a8a0 2026-02-13T01:25:41.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.353+0000 7f52aa7fc6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52940b5600 0x7f52940d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.354+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f52b00e39f0 con 0x7f52bc11a8a0 2026-02-13T01:25:41.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.354+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f52b011c5e0 con 0x7f52bc11a8a0 2026-02-13T01:25:41.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.354+0000 7f52c12506c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52940b5600 0x7f52940d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.354+0000 7f52c12506c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52940b5600 0x7f52940d5ab0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004750 tx=0x7f52ac009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:41.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:41 trial028 ceph-mon[22984]: mds.? [v2:10.20.193.187:6836/1413502445,v1:10.20.193.187:6837/1413502445] up:active 2026-02-13T01:25:41.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:41 trial028 ceph-mon[22984]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2026-02-13T01:25:41.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:41 trial028 ceph-mon[22984]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:25:41.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.472+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f52bc0fe630 con 0x7f52940b5600 2026-02-13T01:25:41.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.493+0000 7f52aa7fc6c0 1 -- 10.20.193.28:0/4239495347 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f52bc0fe630 con 0x7f52940b5600 2026-02-13T01:25:41.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52940b5600 msgr2=0x7f52940d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52940b5600 0x7f52940d5ab0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52ac004750 tx=0x7f52ac009260 comp rx=0 tx=0).stop 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 msgr2=0x7f52bc17b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b140 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52b000b830 tx=0x7f52b000bd00 comp rx=0 tx=0).stop 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 shutdown_connections 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f52940b5600 0x7f52940d5ab0 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f52bc11a8a0 0x7f52bc17b140 unknown :-1 s=CLOSED pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52bc0fdb10 0x7f52bc102de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 --2- 10.20.193.28:0/4239495347 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f52bc114690 0x7f52bc0fd4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 >> 10.20.193.28:0/4239495347 conn(0x7f52bc05cd60 msgr2=0x7f52bc05e160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 shutdown_connections 2026-02-13T01:25:41.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.495+0000 7f528bfff6c0 1 -- 10.20.193.28:0/4239495347 wait complete. 2026-02-13T01:25:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:41 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3918585767' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:25:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:41 trial134 ceph-mon[27948]: pgmap v198: 97 pgs: 89 active+clean, 8 creating+peering; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s wr, 9 op/s 2026-02-13T01:25:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:41 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3918585767' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:25:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:41 trial134 ceph-mon[27948]: mds.? [v2:10.20.193.187:6836/1413502445,v1:10.20.193.187:6837/1413502445] up:active 2026-02-13T01:25:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:41 trial134 ceph-mon[27948]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2026-02-13T01:25:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:41 trial134 ceph-mon[27948]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:25:41.601 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T01:25:41.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:41 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3918585767' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:25:41.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:41 trial187 ceph-mon[27464]: pgmap v198: 97 pgs: 89 active+clean, 8 creating+peering; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s wr, 9 op/s 2026-02-13T01:25:41.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:41 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3918585767' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:25:41.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:41 trial187 ceph-mon[27464]: mds.? [v2:10.20.193.187:6836/1413502445,v1:10.20.193.187:6837/1413502445] up:active 2026-02-13T01:25:41.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:41 trial187 ceph-mon[27464]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2026-02-13T01:25:41.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:41 trial187 ceph-mon[27464]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:25:41.786 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:41.827 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:25:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:25:41.482+0000 7f0c41b696c0 -1 client.14724 error registering admin socket command: (17) File exists 2026-02-13T01:25:41.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 -- 10.20.193.28:0/804927858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec01555e0 msgr2=0x7efec01759c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/804927858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec01555e0 0x7efec01759c0 secure :-1 s=READY pgs=73 gs=3 cs=0 l=1 c_cookie=9524492907555176700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efebc00aa40 tx=0x7efebc02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 -- 10.20.193.28:0/804927858 shutdown_connections 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/804927858 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010c1c0 0x7efec01550a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/804927858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec01555e0 0x7efec01759c0 unknown :-1 s=CLOSED pgs=73 gs=3 cs=0 l=1 c_cookie=9524492907555176700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/804927858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec010b8b0 0x7efec010bc80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 -- 10.20.193.28:0/804927858 >> 10.20.193.28:0/804927858 conn(0x7efec00e9590 msgr2=0x7efec01099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 -- 10.20.193.28:0/804927858 shutdown_connections 2026-02-13T01:25:41.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.983+0000 7efec64fc6c0 1 -- 10.20.193.28:0/804927858 wait complete. 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 Processor -- start 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 -- start start 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 0x7efec0168c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010c1c0 0x7efec01691d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec01555e0 0x7efec016e590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efec016ebe0 con 0x7efec01555e0 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7efec016ed50 con 0x7efec010c1c0 2026-02-13T01:25:41.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec64fc6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7efec016ef10 con 0x7efec010b8b0 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec54fa6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 0x7efec0168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec4cf96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010c1c0 0x7efec01691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec5cfb6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec01555e0 0x7efec016e590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec54fa6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 0x7efec0168c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:55294/0 (socket says 10.20.193.28:55294) 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.984+0000 7efec54fa6c0 1 -- 10.20.193.28:0/1524329728 learned_addr learned my addr 10.20.193.28:0/1524329728 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec54fa6c0 1 -- 10.20.193.28:0/1524329728 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010c1c0 msgr2=0x7efec01691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec54fa6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010c1c0 0x7efec01691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec54fa6c0 1 -- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec01555e0 msgr2=0x7efec016e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec54fa6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec01555e0 0x7efec016e590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec54fa6c0 1 -- 10.20.193.28:0/1524329728 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efebc00a660 con 0x7efec010b8b0 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec54fa6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 0x7efec0168c90 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb0009490 tx=0x7efeb000bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:41.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb0004a80 con 0x7efec010b8b0 2026-02-13T01:25:41.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec016f1f0 con 0x7efec010b8b0 2026-02-13T01:25:41.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efeb0009030 con 0x7efec010b8b0 2026-02-13T01:25:41.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efeb00071c0 con 0x7efec010b8b0 2026-02-13T01:25:41.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec016f8b0 con 0x7efec010b8b0 2026-02-13T01:25:41.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.985+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec005fb30 con 0x7efec010b8b0 2026-02-13T01:25:41.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.988+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7efeb0004060 con 0x7efec010b8b0 2026-02-13T01:25:41.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.989+0000 7efeae7fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5600 0x7efe9c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:41.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.990+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7efeb00e3920 con 0x7efec010b8b0 2026-02-13T01:25:41.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.990+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efeb00e3da0 con 0x7efec010b8b0 2026-02-13T01:25:41.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.990+0000 7efec4cf96c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5600 0x7efe9c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:41.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:41.990+0000 7efec4cf96c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5600 0x7efe9c0d5ab0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec016f620 tx=0x7efeb4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:42.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.108+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efec0169de0 con 0x7efe9c0b5600 2026-02-13T01:25:42.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.123+0000 7efeae7fc6c0 1 -- 10.20.193.28:0/1524329728 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efec0169de0 con 0x7efe9c0b5600 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5600 msgr2=0x7efe9c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5600 0x7efe9c0d5ab0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec016f620 tx=0x7efeb4009260 comp rx=0 tx=0).stop 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 msgr2=0x7efec0168c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 0x7efec0168c90 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efeb0009490 tx=0x7efeb000bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 shutdown_connections 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec01555e0 0x7efec016e590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7efec010c1c0 0x7efec01691d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7efe9c0b5600 0x7efe9c0d5ab0 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 --2- 10.20.193.28:0/1524329728 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7efec010b8b0 0x7efec0168c90 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 >> 10.20.193.28:0/1524329728 conn(0x7efec00e9590 msgr2=0x7efec0109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:42.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.124+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 shutdown_connections 2026-02-13T01:25:42.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.125+0000 7efec64fc6c0 1 -- 10.20.193.28:0/1524329728 wait complete. 2026-02-13T01:25:42.229 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T01:25:42.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:42 trial187 ceph-mon[27464]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:42.413 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:42.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:42 trial028 ceph-mon[22984]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:42 trial134 ceph-mon[27948]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/3202392327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10fa50 msgr2=0x7fbcdc114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 --2- 10.20.193.28:0/3202392327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10fa50 0x7fbcdc114a90 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=14930814011051441157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc40099a0 tx=0x7fbcc402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/3202392327 shutdown_connections 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 --2- 10.20.193.28:0/3202392327 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcdc115270 0x7fbcdc175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 --2- 10.20.193.28:0/3202392327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10fa50 0x7fbcdc114a90 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=14930814011051441157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 --2- 10.20.193.28:0/3202392327 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc10f060 0x7fbcdc10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.607+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/3202392327 >> 10.20.193.28:0/3202392327 conn(0x7fbcdc0ec980 msgr2=0x7fbcdc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.608+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/3202392327 shutdown_connections 2026-02-13T01:25:42.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.608+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/3202392327 wait complete. 2026-02-13T01:25:42.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.608+0000 7fbce1fd86c0 1 Processor -- start 2026-02-13T01:25:42.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.608+0000 7fbce1fd86c0 1 -- start start 2026-02-13T01:25:42.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce1fd86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10f060 0x7fbcdc0f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce1fd86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 0x7fbcdc175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce1fd86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcdc0f4ff0 0x7fbcdc0fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce1fd86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0f56e0 con 0x7fbcdc10f060 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce1fd86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0fa7b0 con 0x7fbcdc115270 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce1fd86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0fa970 con 0x7fbcdc0f4ff0 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 0x7fbcdc175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 0x7fbcdc175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:60836/0 (socket says 10.20.193.28:60836) 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 -- 10.20.193.28:0/1082557839 learned_addr learned my addr 10.20.193.28:0/1082557839 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce0fd66c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10f060 0x7fbcdc0f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce17d76c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcdc0f4ff0 0x7fbcdc0fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 -- 10.20.193.28:0/1082557839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcdc0f4ff0 msgr2=0x7fbcdc0fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcdc0f4ff0 0x7fbcdc0fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 -- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10f060 msgr2=0x7fbcdc0f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10f060 0x7fbcdc0f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 -- 10.20.193.28:0/1082557839 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4009590 con 0x7fbcdc115270 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbce0fd66c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10f060 0x7fbcdc0f49c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.609+0000 7fbcd3fff6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 0x7fbcdc175b10 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4009290 tx=0x7fbcc402fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.610+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc4002ae0 con 0x7fbcdc115270 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.610+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbcc40046b0 con 0x7fbcdc115270 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.610+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/1082557839 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc0fabf0 con 0x7fbcdc115270 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.610+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcc4037290 con 0x7fbcdc115270 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.610+0000 7fbce1fd86c0 1 -- 10.20.193.28:0/1082557839 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc0fb070 con 0x7fbcdc115270 2026-02-13T01:25:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.610+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcdc110330 con 0x7fbcdc115270 2026-02-13T01:25:42.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.612+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fbcc4002c40 con 0x7fbcdc115270 2026-02-13T01:25:42.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.614+0000 7fbcd1ffb6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbcb80b5690 0x7fbcb80d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.614+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7fbcc41079f0 con 0x7fbcdc115270 2026-02-13T01:25:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.614+0000 7fbce0fd66c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbcb80b5690 0x7fbcb80d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.614+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbcc41405e0 con 0x7fbcdc115270 2026-02-13T01:25:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.615+0000 7fbce0fd66c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbcb80b5690 0x7fbcb80d5b40 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbccc004750 tx=0x7fbccc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:42.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.733+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fbcdc0f5ac0 con 0x7fbcb80b5690 2026-02-13T01:25:42.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.736+0000 7fbcd1ffb6c0 1 -- 10.20.193.28:0/1082557839 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fbcdc0f5ac0 con 0x7fbcb80b5690 2026-02-13T01:25:42.736 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_0/691d291a-8fb1-44ca-be5d-01ddbc98644a 2026-02-13T01:25:42.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbcb80b5690 msgr2=0x7fbcb80d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbcb80b5690 0x7fbcb80d5b40 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbccc004750 tx=0x7fbccc009260 comp rx=0 tx=0).stop 2026-02-13T01:25:42.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 msgr2=0x7fbcdc175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 0x7fbcdc175b10 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcc4009290 tx=0x7fbcc402fc60 comp rx=0 tx=0).stop 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 shutdown_connections 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbcb80b5690 0x7fbcb80d5b40 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcdc0f4ff0 0x7fbcdc0fa270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcdc115270 0x7fbcdc175b10 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 --2- 10.20.193.28:0/1082557839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcdc10f060 0x7fbcdc0f49c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 >> 10.20.193.28:0/1082557839 conn(0x7fbcdc0ec980 msgr2=0x7fbcdc10d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 shutdown_connections 2026-02-13T01:25:42.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:42.737+0000 7fbcab7fe6c0 1 -- 10.20.193.28:0/1082557839 wait complete. 2026-02-13T01:25:42.839 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T01:25:43.021 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:43.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3992379515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 msgr2=0x7f0b14175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3992379515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b14175c10 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=12099115534798762763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b1000aa70 tx=0x7f0b1002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3992379515 shutdown_connections 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3992379515 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0b1410fa50 0x7f0b14114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3992379515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b14175c10 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=12099115534798762763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3992379515 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 0x7f0b1410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3992379515 >> 10.20.193.28:0/3992379515 conn(0x7f0b140ec980 msgr2=0x7f0b1410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3992379515 shutdown_connections 2026-02-13T01:25:43.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.226+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3992379515 wait complete. 2026-02-13T01:25:43.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 Processor -- start 2026-02-13T01:25:43.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 -- start start 2026-02-13T01:25:43.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 0x7f0b1411cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b1411d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0b14122860 0x7f0b14122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b14123270 con 0x7f0b14115270 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b141233e0 con 0x7f0b1410f060 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b1a8e06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b141235a0 con 0x7f0b14122860 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b190dd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b1411d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b190dd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b1411d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34608/0 (socket says 10.20.193.28:34608) 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b190dd6c0 1 -- 10.20.193.28:0/3627446981 learned_addr learned my addr 10.20.193.28:0/3627446981 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.227+0000 7f0b198de6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 0x7f0b1411cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b1a0df6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0b14122860 0x7f0b14122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b190dd6c0 1 -- 10.20.193.28:0/3627446981 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0b14122860 msgr2=0x7f0b14122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b190dd6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0b14122860 0x7f0b14122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b190dd6c0 1 -- 10.20.193.28:0/3627446981 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 msgr2=0x7f0b1411cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b190dd6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 0x7f0b1411cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b190dd6c0 1 -- 10.20.193.28:0/3627446981 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b080094c0 con 0x7f0b14115270 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b198de6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 0x7f0b1411cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b190dd6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b1411d4a0 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b0800ba30 tx=0x7f0b0800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b080044a0 con 0x7f0b14115270 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0b08009030 con 0x7f0b14115270 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1000a660 con 0x7f0b14115270 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b080071c0 con 0x7f0b14115270 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.228+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b14163d50 con 0x7f0b14115270 2026-02-13T01:25:43.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.229+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b14110330 con 0x7f0b14115270 2026-02-13T01:25:43.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.231+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f0b080026b0 con 0x7f0b14115270 2026-02-13T01:25:43.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.233+0000 7f0b02ffd6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0af00b5690 0x7f0af00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.233+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f0b080e3c60 con 0x7f0b14115270 2026-02-13T01:25:43.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.233+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b080e40e0 con 0x7f0b14115270 2026-02-13T01:25:43.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.233+0000 7f0b198de6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0af00b5690 0x7f0af00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.234+0000 7f0b198de6c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0af00b5690 0x7f0af00d5b40 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b04004750 tx=0x7f0b04009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:43.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.352+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0b1410fa50 con 0x7f0af00b5690 2026-02-13T01:25:43.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:43 trial028 ceph-mon[22984]: from='client.24688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:43.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:43 trial028 ceph-mon[22984]: mgrmap e11: x(active, since 2m), standbys: z, y 2026-02-13T01:25:43.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:43 trial028 ceph-mon[22984]: pgmap v199: 97 pgs: 97 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 270 B/s rd, 3.0 KiB/s wr, 10 op/s 2026-02-13T01:25:43.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:43 trial028 ceph-mon[22984]: from='client.24668 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:43.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.402+0000 7f0b02ffd6c0 1 -- 10.20.193.28:0/3627446981 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b1410fa50 con 0x7f0af00b5690 2026-02-13T01:25:43.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0af00b5690 msgr2=0x7f0af00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0af00b5690 0x7f0af00d5b40 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b04004750 tx=0x7f0b04009260 comp rx=0 tx=0).stop 2026-02-13T01:25:43.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 msgr2=0x7f0b1411d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b1411d4a0 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b0800ba30 tx=0x7f0b0800bf00 comp rx=0 tx=0).stop 2026-02-13T01:25:43.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 shutdown_connections 2026-02-13T01:25:43.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0af00b5690 0x7f0af00d5b40 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0b14122860 0x7f0b14122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b14115270 0x7f0b1411d4a0 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 --2- 10.20.193.28:0/3627446981 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0b1410f060 0x7f0b1411cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 >> 10.20.193.28:0/3627446981 conn(0x7f0b140ec980 msgr2=0x7f0b1410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:43.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 shutdown_connections 2026-02-13T01:25:43.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.405+0000 7f0b1a8e06c0 1 -- 10.20.193.28:0/3627446981 wait complete. 2026-02-13T01:25:43.511 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T01:25:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:43 trial134 ceph-mon[27948]: from='client.24688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:43 trial134 ceph-mon[27948]: mgrmap e11: x(active, since 2m), standbys: z, y 2026-02-13T01:25:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:43 trial134 ceph-mon[27948]: pgmap v199: 97 pgs: 97 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 270 B/s rd, 3.0 KiB/s wr, 10 op/s 2026-02-13T01:25:43.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:43 trial134 ceph-mon[27948]: from='client.24668 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:43.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:43 trial187 ceph-mon[27464]: from='client.24688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:43.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:43 trial187 ceph-mon[27464]: mgrmap e11: x(active, since 2m), standbys: z, y 2026-02-13T01:25:43.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:43 trial187 ceph-mon[27464]: pgmap v199: 97 pgs: 97 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 270 B/s rd, 3.0 KiB/s wr, 10 op/s 2026-02-13T01:25:43.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:43 trial187 ceph-mon[27464]: from='client.24668 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:43.692 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 -- 10.20.193.28:0/937664291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10fa50 msgr2=0x7fc00c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 --2- 10.20.193.28:0/937664291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10fa50 0x7fc00c114a90 secure :-1 s=READY pgs=189 gs=3 cs=0 l=1 c_cookie=1827538180113171033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbff40098d0 tx=0x7fbff402ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 -- 10.20.193.28:0/937664291 shutdown_connections 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 --2- 10.20.193.28:0/937664291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc00c115270 0x7fc00c175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 --2- 10.20.193.28:0/937664291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10fa50 0x7fc00c114a90 unknown :-1 s=CLOSED pgs=189 gs=3 cs=0 l=1 c_cookie=1827538180113171033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 --2- 10.20.193.28:0/937664291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c10f060 0x7fc00c10f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 -- 10.20.193.28:0/937664291 >> 10.20.193.28:0/937664291 conn(0x7fc00c0ec980 msgr2=0x7fc00c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 -- 10.20.193.28:0/937664291 shutdown_connections 2026-02-13T01:25:43.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 -- 10.20.193.28:0/937664291 wait complete. 2026-02-13T01:25:43.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.892+0000 7fc00b5776c0 1 Processor -- start 2026-02-13T01:25:43.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 -- start start 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 0x7fc00c0f4a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c115270 0x7fc00c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc00c0f50a0 0x7fc00c0fa370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0f5790 con 0x7fc00c10f060 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0fa8b0 con 0x7fc00c0f50a0 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00b5776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0faa70 con 0x7fc00c115270 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00a5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 0x7fc00c0f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00a5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 0x7fc00c0f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34624/0 (socket says 10.20.193.28:34624) 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00a5756c0 1 -- 10.20.193.28:0/2958701110 learned_addr learned my addr 10.20.193.28:0/2958701110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc009d746c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c115270 0x7fc00c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00ad766c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc00c0f50a0 0x7fc00c0fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc009d746c0 1 -- 10.20.193.28:0/2958701110 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc00c0f50a0 msgr2=0x7fc00c0fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc009d746c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc00c0f50a0 0x7fc00c0fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc009d746c0 1 -- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 msgr2=0x7fc00c0f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc009d746c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 0x7fc00c0f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc009d746c0 1 -- 10.20.193.28:0/2958701110 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff40094c0 con 0x7fc00c115270 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.893+0000 7fc00a5756c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 0x7fc00c0f4a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fc009d746c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c115270 0x7fc00c175b10 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc00c055f00 tx=0x7fbff402fba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:43.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbff4002ae0 con 0x7fc00c115270 2026-02-13T01:25:43.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fc00b5776c0 1 -- 10.20.193.28:0/2958701110 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c0facf0 con 0x7fc00c115270 2026-02-13T01:25:43.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbff40045d0 con 0x7fc00c115270 2026-02-13T01:25:43.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbff4031440 con 0x7fc00c115270 2026-02-13T01:25:43.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fc00b5776c0 1 -- 10.20.193.28:0/2958701110 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c0fb1c0 con 0x7fc00c115270 2026-02-13T01:25:43.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.894+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c110330 con 0x7fc00c115270 2026-02-13T01:25:43.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.897+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fbff4002c40 con 0x7fc00c115270 2026-02-13T01:25:43.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.898+0000 7fbff37fe6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbfe40b5710 0x7fbfe40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:43.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.899+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7fbff4107ab0 con 0x7fc00c115270 2026-02-13T01:25:43.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.899+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbff41405e0 con 0x7fc00c115270 2026-02-13T01:25:43.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.899+0000 7fc00a5756c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbfe40b5710 0x7fbfe40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:43.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:43.899+0000 7fc00a5756c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbfe40b5710 0x7fbfe40d5bc0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc000004750 tx=0x7fc000009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:44.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.020+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fc00c0f5bc0 con 0x7fbfe40b5710 2026-02-13T01:25:44.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.023+0000 7fbff37fe6c0 1 -- 10.20.193.28:0/2958701110 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc00c0f5bc0 con 0x7fbfe40b5710 2026-02-13T01:25:44.023 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_1/d4dcc8c8-2596-4108-abbe-e3b011ab3987 2026-02-13T01:25:44.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbfe40b5710 msgr2=0x7fbfe40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbfe40b5710 0x7fbfe40d5bc0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc000004750 tx=0x7fc000009310 comp rx=0 tx=0).stop 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c115270 msgr2=0x7fc00c175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c115270 0x7fc00c175b10 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc00c055f00 tx=0x7fbff402fba0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 shutdown_connections 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbfe40b5710 0x7fbfe40d5bc0 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc00c115270 0x7fc00c175b10 unknown :-1 s=CLOSED pgs=80 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc00c0f50a0 0x7fc00c0fa370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 --2- 10.20.193.28:0/2958701110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc00c10f060 0x7fc00c0f4a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 >> 10.20.193.28:0/2958701110 conn(0x7fc00c0ec980 msgr2=0x7fc00c113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:44.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 shutdown_connections 2026-02-13T01:25:44.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.024+0000 7fbff17fa6c0 1 -- 10.20.193.28:0/2958701110 wait complete. 2026-02-13T01:25:44.162 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:44.346 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:44.389 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:44 trial028 ceph-mon[22984]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:44.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 -- 10.20.193.28:0/3614447732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 msgr2=0x7f320c179cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 --2- 10.20.193.28:0/3614447732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 0x7f320c179cf0 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=4118612524839395973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f320000aa40 tx=0x7f320002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 -- 10.20.193.28:0/3614447732 shutdown_connections 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 --2- 10.20.193.28:0/3614447732 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c060ce0 0x7f320c061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 --2- 10.20.193.28:0/3614447732 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 0x7f320c179cf0 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=4118612524839395973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 --2- 10.20.193.28:0/3614447732 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c0622d0 0x7f320c0607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 -- 10.20.193.28:0/3614447732 >> 10.20.193.28:0/3614447732 conn(0x7f320c0ea6d0 msgr2=0x7f320c10aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 -- 10.20.193.28:0/3614447732 shutdown_connections 2026-02-13T01:25:44.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.546+0000 7f32117386c0 1 -- 10.20.193.28:0/3614447732 wait complete. 2026-02-13T01:25:44.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.547+0000 7f32117386c0 1 Processor -- start 2026-02-13T01:25:44.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.547+0000 7f32117386c0 1 -- start start 2026-02-13T01:25:44.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f32117386c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 0x7f320c0f2040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f32117386c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c0622d0 0x7f320c0f2580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f32117386c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 0x7f320c0f7940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f32117386c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0f7f90 con 0x7f320c159910 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f32117386c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0f8100 con 0x7f320c060ce0 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f32117386c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0f82c0 con 0x7f320c0622d0 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320bfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 0x7f320c0f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f3210f376c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 0x7f320c0f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320bfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 0x7f320c0f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:60874/0 (socket says 10.20.193.28:60874) 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320bfff6c0 1 -- 10.20.193.28:0/3877775344 learned_addr learned my addr 10.20.193.28:0/3877775344 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c0622d0 0x7f320c0f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:44.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 -- 10.20.193.28:0/3877775344 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 msgr2=0x7f320c0f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 0x7f320c0f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 -- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 msgr2=0x7f320c0f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 0x7f320c0f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 -- 10.20.193.28:0/3877775344 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320000a660 con 0x7f320c0622d0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320bfff6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 0x7f320c0f2040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.548+0000 7f320b7fe6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c0622d0 0x7f320c0f2580 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31fc00b6c0 tx=0x7f31fc00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.549+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31fc004240 con 0x7f320c0622d0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.549+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f31fc009030 con 0x7f320c0622d0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.549+0000 7f32117386c0 1 -- 10.20.193.28:0/3877775344 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c0f85a0 con 0x7f320c0622d0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.549+0000 7f32117386c0 1 -- 10.20.193.28:0/3877775344 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c0f8c60 con 0x7f320c0622d0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.549+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31fc0036e0 con 0x7f320c0622d0 2026-02-13T01:25:44.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.549+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320c0f87c0 con 0x7f320c0622d0 2026-02-13T01:25:44.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:44 trial134 ceph-mon[27948]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:44.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.551+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f31fc0038a0 con 0x7f320c0622d0 2026-02-13T01:25:44.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.553+0000 7f32097fa6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31e00b5690 0x7f31e00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:44.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.553+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f31fc0e3950 con 0x7f320c0622d0 2026-02-13T01:25:44.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.553+0000 7f320bfff6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31e00b5690 0x7f31e00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:44.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.553+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f31fc0e3dd0 con 0x7f320c0622d0 2026-02-13T01:25:44.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.554+0000 7f320bfff6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31e00b5690 0x7f31e00d5b40 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31f80095e0 tx=0x7f31f8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:44.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:44 trial187 ceph-mon[27464]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:44.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.676+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f320c061110 con 0x7f320c0622d0 2026-02-13T01:25:44.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.677+0000 7f32097fa6c0 1 -- 10.20.193.28:0/3877775344 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11935 (secure 0 0 0) 0x7f31fc0a6370 con 0x7f320c0622d0 2026-02-13T01:25:44.677 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:44.677 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-13T01:25:40:869974+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/2406277277","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":2406277277},{"type":"v1","addr":"10.20.193.28:6837","nonce":2406277277}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14631,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/723111471","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":723111471},{"type":"v1","addr":"10.20.193.28:6839","nonce":723111471}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/523456134","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":523456134},{"type":"v1","addr":"10.20.193.28:6841","nonce":523456134}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24509,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6833/1945194409","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6832","nonce":1945194409},{"type":"v1","addr":"10.20.193.134:6833","nonce":1945194409}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24523,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.187:6833/60649704","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6832","nonce":60649704},{"type":"v1","addr":"10.20.193.187:6833","nonce":60649704}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.134:6835/528218055","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6834","nonce":528218055},{"type":"v1","addr":"10.20.193.134:6835","nonce":528218055}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T01:25:35.778041+0000","modified":"2026-02-13T01:25:40.869951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24583,"mds_1":24578,"mds_2":24568},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24538":{"gid":24538,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.28:6835/1374905070","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":1374905070},{"type":"v1","addr":"10.20.193.28:6835","nonce":1374905070}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.134:6837/583645151","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6836","nonce":583645151},{"type":"v1","addr":"10.20.193.134:6837","nonce":583645151}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.187:6835/1888846931","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6834","nonce":1888846931},{"type":"v1","addr":"10.20.193.187:6835","nonce":1888846931}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":5,"addr":"10.20.193.187:6837/1413502445","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6836","nonce":1413502445},{"type":"v1","addr":"10.20.193.187:6837","nonce":1413502445}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":4,"addr":"10.20.193.134:6839/522432871","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6838","nonce":522432871},{"type":"v1","addr":"10.20.193.134:6839","nonce":522432871}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"10.20.193.187:6839/2636275695","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6838","nonce":2636275695},{"type":"v1","addr":"10.20.193.187:6839","nonce":2636275695}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24583,"qdb_cluster":[24583,24578,24568]},"id":1}]} 2026-02-13T01:25:44.678 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31e00b5690 msgr2=0x7f31e00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31e00b5690 0x7f31e00d5b40 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31f80095e0 tx=0x7f31f8009260 comp rx=0 tx=0).stop 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c0622d0 msgr2=0x7f320c0f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c0622d0 0x7f320c0f2580 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31fc00b6c0 tx=0x7f31fc00bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 shutdown_connections 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31e00b5690 0x7f31e00d5b40 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f320c0622d0 0x7f320c0f2580 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c159910 0x7f320c0f7940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 --2- 10.20.193.28:0/3877775344 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f320c060ce0 0x7f320c0f2040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 >> 10.20.193.28:0/3877775344 conn(0x7f320c0ea6d0 msgr2=0x7f320c10ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:44.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 shutdown_connections 2026-02-13T01:25:44.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:44.678+0000 7f31deffd6c0 1 -- 10.20.193.28:0/3877775344 wait complete. 2026-02-13T01:25:44.783 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:44.967 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 -- 10.20.193.28:0/2955916834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e010c2d0 msgr2=0x7fa4e01108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 --2- 10.20.193.28:0/2955916834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e010c2d0 0x7fa4e01108a0 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=16773556245262723971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4c8009970 tx=0x7fa4c802ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 -- 10.20.193.28:0/2955916834 shutdown_connections 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 --2- 10.20.193.28:0/2955916834 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e0110ef0 0x7fa4e0111370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 --2- 10.20.193.28:0/2955916834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e010c2d0 0x7fa4e01108a0 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=16773556245262723971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 --2- 10.20.193.28:0/2955916834 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e010bcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 -- 10.20.193.28:0/2955916834 >> 10.20.193.28:0/2955916834 conn(0x7fa4e00e9570 msgr2=0x7fa4e0109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 -- 10.20.193.28:0/2955916834 shutdown_connections 2026-02-13T01:25:45.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.159+0000 7fa4e58636c0 1 -- 10.20.193.28:0/2955916834 wait complete. 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.160+0000 7fa4e58636c0 1 Processor -- start 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.160+0000 7fa4e58636c0 1 -- start start 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.160+0000 7fa4e58636c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e01218c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.160+0000 7fa4e58636c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e010c2d0 0x7fa4e0121e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e58636c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e0110ef0 0x7fa4e01271c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e58636c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e0127810 con 0x7fa4e0110ef0 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e58636c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e0127980 con 0x7fa4e010c2d0 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e58636c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e0127b40 con 0x7fa4e010b8e0 2026-02-13T01:25:45.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e48616c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e01218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e48616c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e01218c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:55362/0 (socket says 10.20.193.28:55362) 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e48616c0 1 -- 10.20.193.28:0/3107527587 learned_addr learned my addr 10.20.193.28:0/3107527587 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4d7fff6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e010c2d0 0x7fa4e0121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e50626c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e0110ef0 0x7fa4e01271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4d7fff6c0 1 -- 10.20.193.28:0/3107527587 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 msgr2=0x7fa4e01218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4d7fff6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e01218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4d7fff6c0 1 -- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e0110ef0 msgr2=0x7fa4e01271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4d7fff6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e0110ef0 0x7fa4e01271c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4d7fff6c0 1 -- 10.20.193.28:0/3107527587 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c8009590 con 0x7fa4e010c2d0 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e48616c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e01218c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.161+0000 7fa4e50626c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e0110ef0 0x7fa4e01271c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.162+0000 7fa4d7fff6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e010c2d0 0x7fa4e0121e00 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4c802fb90 tx=0x7fa4c802fbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.162+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4c8002ba0 con 0x7fa4e010c2d0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.162+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa4c8002d00 con 0x7fa4e010c2d0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.162+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4c80362f0 con 0x7fa4e010c2d0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.162+0000 7fa4e58636c0 1 -- 10.20.193.28:0/3107527587 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e0127e20 con 0x7fa4e010c2d0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.162+0000 7fa4e58636c0 1 -- 10.20.193.28:0/3107527587 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e0168500 con 0x7fa4e010c2d0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.163+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e0128040 con 0x7fa4e010c2d0 2026-02-13T01:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.165+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fa4c80071c0 con 0x7fa4e010c2d0 2026-02-13T01:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.167+0000 7fa4d5ffb6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4bc0b5710 0x7fa4bc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.167+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7fa4c8107a50 con 0x7fa4e010c2d0 2026-02-13T01:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.167+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4c80ca470 con 0x7fa4e010c2d0 2026-02-13T01:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.167+0000 7fa4e48616c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4bc0b5710 0x7fa4bc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.167+0000 7fa4e48616c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4bc0b5710 0x7fa4bc0d5bc0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4d0009240 tx=0x7fa4d0009420 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:45.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.268+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4e005fb90 con 0x7fa4e010c2d0 2026-02-13T01:25:45.269 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:45 trial028 ceph-mon[22984]: from='client.24706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:45.269 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:45 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3877775344' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:45.270 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:45 trial028 ceph-mon[22984]: pgmap v200: 97 pgs: 97 active+clean; 606 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-13T01:25:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.268+0000 7fa4d5ffb6c0 1 -- 10.20.193.28:0/3107527587 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22038 (secure 0 0 0) 0x7fa4c80cd620 con 0x7fa4e010c2d0 2026-02-13T01:25:45.272 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:45.272 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":75,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","created":"2026-02-13T01:22:41.806447+0000","modified":"2026-02-13T01:25:37.132531+0000","last_up_change":"2026-02-13T01:25:14.875697+0000","last_in_change":"2026-02-13T01:25:06.785151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:58.205191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:33.235628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:34.724553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b609cc73-d28a-4ba8-9724-13ee6cc98de8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6803","nonce":2961143377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6805","nonce":2961143377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6809","nonce":2961143377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6807","nonce":2961143377}]},"public_addr":"10.20.193.28:6803/2961143377","cluster_addr":"10.20.193.28:6805/2961143377","heartbeat_back_addr":"10.20.193.28:6809/2961143377","heartbeat_front_addr":"10.20.193.28:6807/2961143377","state":["exists","up"]},{"osd":1,"uuid":"8b21607c-6340-49b2-ae85-eb92729919c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6800","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6801","nonce":2922978638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6802","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6803","nonce":2922978638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6806","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6807","nonce":2922978638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6804","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6805","nonce":2922978638}]},"public_addr":"10.20.193.134:6801/2922978638","cluster_addr":"10.20.193.134:6803/2922978638","heartbeat_back_addr":"10.20.193.134:6807/2922978638","heartbeat_front_addr":"10.20.193.134:6805/2922978638","state":["exists","up"]},{"osd":2,"uuid":"6f3ebd5b-92a4-4b56-b83b-1ef57483f823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6800","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6801","nonce":28326527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6802","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6803","nonce":28326527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6806","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6807","nonce":28326527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6804","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6805","nonce":28326527}]},"public_addr":"10.20.193.187:6801/28326527","cluster_addr":"10.20.193.187:6803/28326527","heartbeat_back_addr":"10.20.193.187:6807/28326527","heartbeat_front_addr":"10.20.193.187:6805/28326527","state":["exists","up"]},{"osd":3,"uuid":"f8c87696-e524-441f-b262-8f1b1b088b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6811","nonce":3039326126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6813","nonce":3039326126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6817","nonce":3039326126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6815","nonce":3039326126}]},"public_addr":"10.20.193.28:6811/3039326126","cluster_addr":"10.20.193.28:6813/3039326126","heartbeat_back_addr":"10.20.193.28:6817/3039326126","heartbeat_front_addr":"10.20.193.28:6815/3039326126","state":["exists","up"]},{"osd":4,"uuid":"181c4948-a9b0-4bf5-bb9a-5071865e44ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6808","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6809","nonce":2852482005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6810","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6811","nonce":2852482005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6814","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6815","nonce":2852482005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6812","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6813","nonce":2852482005}]},"public_addr":"10.20.193.134:6809/2852482005","cluster_addr":"10.20.193.134:6811/2852482005","heartbeat_back_addr":"10.20.193.134:6815/2852482005","heartbeat_front_addr":"10.20.193.134:6813/2852482005","state":["exists","up"]},{"osd":5,"uuid":"05fa2cf3-9b55-4589-9db7-f7f20c478be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6808","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6809","nonce":3424321792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6810","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6811","nonce":3424321792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6814","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6815","nonce":3424321792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6812","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6813","nonce":3424321792}]},"public_addr":"10.20.193.187:6809/3424321792","cluster_addr":"10.20.193.187:6811/3424321792","heartbeat_back_addr":"10.20.193.187:6815/3424321792","heartbeat_front_addr":"10.20.193.187:6813/3424321792","state":["exists","up"]},{"osd":6,"uuid":"7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6819","nonce":2743891845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6821","nonce":2743891845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6825","nonce":2743891845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6823","nonce":2743891845}]},"public_addr":"10.20.193.28:6819/2743891845","cluster_addr":"10.20.193.28:6821/2743891845","heartbeat_back_addr":"10.20.193.28:6825/2743891845","heartbeat_front_addr":"10.20.193.28:6823/2743891845","state":["exists","up"]},{"osd":7,"uuid":"83f5f6ed-fa57-4628-bcf0-49d51edea60d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6816","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6817","nonce":55376257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6818","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6819","nonce":55376257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6822","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6823","nonce":55376257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6820","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6821","nonce":55376257}]},"public_addr":"10.20.193.134:6817/55376257","cluster_addr":"10.20.193.134:6819/55376257","heartbeat_back_addr":"10.20.193.134:6823/55376257","heartbeat_front_addr":"10.20.193.134:6821/55376257","state":["exists","up"]},{"osd":8,"uuid":"63963560-6c24-4627-aade-6d99ec304b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6816","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6817","nonce":2802029994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6818","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6819","nonce":2802029994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6822","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6823","nonce":2802029994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6820","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6821","nonce":2802029994}]},"public_addr":"10.20.193.187:6817/2802029994","cluster_addr":"10.20.193.187:6819/2802029994","heartbeat_back_addr":"10.20.193.187:6823/2802029994","heartbeat_front_addr":"10.20.193.187:6821/2802029994","state":["exists","up"]},{"osd":9,"uuid":"184bf253-88c2-45c2-a17b-e1d06b4b1985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6827","nonce":1895700373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6829","nonce":1895700373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6833","nonce":1895700373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6831","nonce":1895700373}]},"public_addr":"10.20.193.28:6827/1895700373","cluster_addr":"10.20.193.28:6829/1895700373","heartbeat_back_addr":"10.20.193.28:6833/1895700373","heartbeat_front_addr":"10.20.193.28:6831/1895700373","state":["exists","up"]},{"osd":10,"uuid":"d23958fb-8b6d-4d42-9a41-d55ea62f4328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6824","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6825","nonce":1465401365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6826","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6827","nonce":1465401365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6830","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6831","nonce":1465401365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6828","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6829","nonce":1465401365}]},"public_addr":"10.20.193.134:6825/1465401365","cluster_addr":"10.20.193.134:6827/1465401365","heartbeat_back_addr":"10.20.193.134:6831/1465401365","heartbeat_front_addr":"10.20.193.134:6829/1465401365","state":["exists","up"]},{"osd":11,"uuid":"49d3cb86-161d-4c61-af51-58a293ae6948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6824","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6825","nonce":3880817278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6826","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6827","nonce":3880817278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6830","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6831","nonce":3880817278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6828","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6829","nonce":3880817278}]},"public_addr":"10.20.193.187:6825/3880817278","cluster_addr":"10.20.193.187:6827/3880817278","heartbeat_back_addr":"10.20.193.187:6831/3880817278","heartbeat_front_addr":"10.20.193.187:6829/3880817278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.844101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:48.399902+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.304413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:06.142985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:13.695054+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:20.759285+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.814864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:39.345155+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.698150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:58.098934+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:05.932878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:13.217409+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/2396565153":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/2466054030":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/4240498935":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6801/4264511310":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6800/4264511310":"2026-02-14T01:22:50.011933+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4bc0b5710 msgr2=0x7fa4bc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4bc0b5710 0x7fa4bc0d5bc0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4d0009240 tx=0x7fa4d0009420 comp rx=0 tx=0).stop 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e010c2d0 msgr2=0x7fa4e0121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e010c2d0 0x7fa4e0121e00 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4c802fb90 tx=0x7fa4c802fbc0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 shutdown_connections 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa4e0110ef0 0x7fa4e01271c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa4e010c2d0 0x7fa4e0121e00 unknown :-1 s=CLOSED pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4bc0b5710 0x7fa4bc0d5bc0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 --2- 10.20.193.28:0/3107527587 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa4e010b8e0 0x7fa4e01218c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 >> 10.20.193.28:0/3107527587 conn(0x7fa4e00e9570 msgr2=0x7fa4e0109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:45.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 shutdown_connections 2026-02-13T01:25:45.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.270+0000 7fa4af7fe6c0 1 -- 10.20.193.28:0/3107527587 wait complete. 2026-02-13T01:25:45.374 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T01:25:45.374 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:45 trial134 ceph-mon[27948]: from='client.24706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:45 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3877775344' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:45.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:45 trial134 ceph-mon[27948]: pgmap v200: 97 pgs: 97 active+clean; 606 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-13T01:25:45.556 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:45.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:45 trial187 ceph-mon[27464]: from='client.24706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:45.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:45 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3877775344' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:45.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:45 trial187 ceph-mon[27464]: pgmap v200: 97 pgs: 97 active+clean; 606 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 8.2 KiB/s wr, 17 op/s 2026-02-13T01:25:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 -- 10.20.193.28:0/4227492454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010fa50 msgr2=0x7f4970114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/4227492454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010fa50 0x7f4970114a90 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=12851220956101136023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49580099a0 tx=0x7f495802ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 -- 10.20.193.28:0/4227492454 shutdown_connections 2026-02-13T01:25:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/4227492454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 0x7f4970175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/4227492454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010fa50 0x7f4970114a90 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=12851220956101136023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/4227492454 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f497010f060 0x7f497010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 -- 10.20.193.28:0/4227492454 >> 10.20.193.28:0/4227492454 conn(0x7f49700ec980 msgr2=0x7f497010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 -- 10.20.193.28:0/4227492454 shutdown_connections 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.763+0000 7f4975bf36c0 1 -- 10.20.193.28:0/4227492454 wait complete. 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 Processor -- start 2026-02-13T01:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 -- start start 2026-02-13T01:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 0x7f49700f4a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 0x7f4970175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49700f5040 0x7f49700fa310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49700f5730 con 0x7f497010f060 2026-02-13T01:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49700fa850 con 0x7f49700f5040 2026-02-13T01:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.764+0000 7f4975bf36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f49700faa10 con 0x7f4970115270 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4974bf16c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 0x7f49700f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4974bf16c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 0x7f49700f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34684/0 (socket says 10.20.193.28:34684) 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4974bf16c0 1 -- 10.20.193.28:0/3633663740 learned_addr learned my addr 10.20.193.28:0/3633663740 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 0x7f4970175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f49753f26c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49700f5040 0x7f49700fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 -- 10.20.193.28:0/3633663740 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49700f5040 msgr2=0x7f49700fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49700f5040 0x7f49700fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 -- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 msgr2=0x7f49700f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 0x7f49700f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 -- 10.20.193.28:0/3633663740 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4958009590 con 0x7f4970115270 2026-02-13T01:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4974bf16c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 0x7f49700f4a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4967fff6c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 0x7f4970175b10 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49580099a0 tx=0x7f495802fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4958002ae0 con 0x7f4970115270 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.765+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49700fac90 con 0x7f4970115270 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.766+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49700fb130 con 0x7f4970115270 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.766+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f49580046b0 con 0x7f4970115270 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.766+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4958037480 con 0x7f4970115270 2026-02-13T01:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.766+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4970110330 con 0x7f4970115270 2026-02-13T01:25:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.768+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f4958007a40 con 0x7f4970115270 2026-02-13T01:25:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.770+0000 7f4965ffb6c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f494c0b5790 0x7f494c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.770+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f4958107cd0 con 0x7f4970115270 2026-02-13T01:25:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.770+0000 7f4974bf16c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f494c0b5790 0x7f494c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.770+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49581080d0 con 0x7f4970115270 2026-02-13T01:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.770+0000 7f4974bf16c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f494c0b5790 0x7f494c0d5c40 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4960009260 tx=0x7f4960009440 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.870+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49700f5b60 con 0x7f494c0b5790 2026-02-13T01:25:45.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.874+0000 7f4965ffb6c0 1 -- 10.20.193.28:0/3633663740 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258931 (secure 0 0 0) 0x7f49700f5b60 con 0x7f494c0b5790 2026-02-13T01:25:45.878 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:45.879 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:45.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.876+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f494c0b5790 msgr2=0x7f494c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.876+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f494c0b5790 0x7f494c0d5c40 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4960009260 tx=0x7f4960009440 comp rx=0 tx=0).stop 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.876+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 msgr2=0x7f4970175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.876+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 0x7f4970175b10 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49580099a0 tx=0x7f495802fc60 comp rx=0 tx=0).stop 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 shutdown_connections 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f494c0b5790 0x7f494c0d5c40 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4970115270 0x7f4970175b10 unknown :-1 s=CLOSED pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f49700f5040 0x7f49700fa310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 --2- 10.20.193.28:0/3633663740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010f060 0x7f49700f4a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 >> 10.20.193.28:0/3633663740 conn(0x7f49700ec980 msgr2=0x7f497010d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 shutdown_connections 2026-02-13T01:25:45.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:45.877+0000 7f4975bf36c0 1 -- 10.20.193.28:0/3633663740 wait complete. 2026-02-13T01:25:45.983 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2026-02-13T01:25:44.700132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620165,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":315,"num_write_kb":3786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":264,"ondisk_log_size":264,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333312,"kb_used_data":9744,"kb_used_omap":394,"kb_used_meta":322933,"kb_avail":8807705088,"statfs":{"total":9019431321600,"available":9019090010112,"internally_reserved":0,"allocated":9977856,"data_stored":6362574,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":404157,"internal_metadata":330683715},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29797,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":27,"num_read_kb":28,"num_write":126,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.573005"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565113+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:37.565113+0000","last_peered":"2026-02-13T01:25:37.565113+0000","last_clean":"2026-02-13T01:25:37.565113+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:37.565113+0000","last_undegraded":"2026-02-13T01:25:37.565113+0000","last_fullsized":"2026-02-13T01:25:37.565113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137998+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:37.137998+0000","last_peered":"2026-02-13T01:25:37.137998+0000","last_clean":"2026-02-13T01:25:37.137998+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:37.137998+0000","last_undegraded":"2026-02-13T01:25:37.137998+0000","last_fullsized":"2026-02-13T01:25:37.137998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137793+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:37.137793+0000","last_peered":"2026-02-13T01:25:37.137793+0000","last_clean":"2026-02-13T01:25:37.137793+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:37.137793+0000","last_undegraded":"2026-02-13T01:25:37.137793+0000","last_fullsized":"2026-02-13T01:25:37.137793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626362+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:37.626362+0000","last_peered":"2026-02-13T01:25:37.626362+0000","last_clean":"2026-02-13T01:25:37.626362+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:37.626362+0000","last_undegraded":"2026-02-13T01:25:37.626362+0000","last_fullsized":"2026-02-13T01:25:37.626362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422868+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:37.422868+0000","last_peered":"2026-02-13T01:25:37.422868+0000","last_clean":"2026-02-13T01:25:37.422868+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:37.422868+0000","last_undegraded":"2026-02-13T01:25:37.422868+0000","last_fullsized":"2026-02-13T01:25:37.422868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139220+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:37.139220+0000","last_peered":"2026-02-13T01:25:37.139220+0000","last_clean":"2026-02-13T01:25:37.139220+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:37.139220+0000","last_undegraded":"2026-02-13T01:25:37.139220+0000","last_fullsized":"2026-02-13T01:25:37.139220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626030+0000","last_change":"2026-02-13T01:25:36.136782+0000","last_active":"2026-02-13T01:25:37.626030+0000","last_peered":"2026-02-13T01:25:37.626030+0000","last_clean":"2026-02-13T01:25:37.626030+0000","last_became_active":"2026-02-13T01:25:36.136618+0000","last_became_peered":"2026-02-13T01:25:36.136618+0000","last_unstale":"2026-02-13T01:25:37.626030+0000","last_undegraded":"2026-02-13T01:25:37.626030+0000","last_fullsized":"2026-02-13T01:25:37.626030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:20.569294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137610+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:37.137610+0000","last_peered":"2026-02-13T01:25:37.137610+0000","last_clean":"2026-02-13T01:25:37.137610+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:37.137610+0000","last_undegraded":"2026-02-13T01:25:37.137610+0000","last_fullsized":"2026-02-13T01:25:37.137610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139626+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:37.139626+0000","last_peered":"2026-02-13T01:25:37.139626+0000","last_clean":"2026-02-13T01:25:37.139626+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:37.139626+0000","last_undegraded":"2026-02-13T01:25:37.139626+0000","last_fullsized":"2026-02-13T01:25:37.139626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139632+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:37.139632+0000","last_peered":"2026-02-13T01:25:37.139632+0000","last_clean":"2026-02-13T01:25:37.139632+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:37.139632+0000","last_undegraded":"2026-02-13T01:25:37.139632+0000","last_fullsized":"2026-02-13T01:25:37.139632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626265+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:37.626265+0000","last_peered":"2026-02-13T01:25:37.626265+0000","last_clean":"2026-02-13T01:25:37.626265+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:37.626265+0000","last_undegraded":"2026-02-13T01:25:37.626265+0000","last_fullsized":"2026-02-13T01:25:37.626265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626410+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:37.626410+0000","last_peered":"2026-02-13T01:25:37.626410+0000","last_clean":"2026-02-13T01:25:37.626410+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:37.626410+0000","last_undegraded":"2026-02-13T01:25:37.626410+0000","last_fullsized":"2026-02-13T01:25:37.626410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625193+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:37.625193+0000","last_peered":"2026-02-13T01:25:37.625193+0000","last_clean":"2026-02-13T01:25:37.625193+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:37.625193+0000","last_undegraded":"2026-02-13T01:25:37.625193+0000","last_fullsized":"2026-02-13T01:25:37.625193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138324+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:37.138324+0000","last_peered":"2026-02-13T01:25:37.138324+0000","last_clean":"2026-02-13T01:25:37.138324+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:37.138324+0000","last_undegraded":"2026-02-13T01:25:37.138324+0000","last_fullsized":"2026-02-13T01:25:37.138324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138245+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:37.138245+0000","last_peered":"2026-02-13T01:25:37.138245+0000","last_clean":"2026-02-13T01:25:37.138245+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:37.138245+0000","last_undegraded":"2026-02-13T01:25:37.138245+0000","last_fullsized":"2026-02-13T01:25:37.138245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139321+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:37.139321+0000","last_peered":"2026-02-13T01:25:37.139321+0000","last_clean":"2026-02-13T01:25:37.139321+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:37.139321+0000","last_undegraded":"2026-02-13T01:25:37.139321+0000","last_fullsized":"2026-02-13T01:25:37.139321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565131+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:37.565131+0000","last_peered":"2026-02-13T01:25:37.565131+0000","last_clean":"2026-02-13T01:25:37.565131+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:37.565131+0000","last_undegraded":"2026-02-13T01:25:37.565131+0000","last_fullsized":"2026-02-13T01:25:37.565131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625069+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:37.625069+0000","last_peered":"2026-02-13T01:25:37.625069+0000","last_clean":"2026-02-13T01:25:37.625069+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:37.625069+0000","last_undegraded":"2026-02-13T01:25:37.625069+0000","last_fullsized":"2026-02-13T01:25:37.625069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.627353+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:37.627353+0000","last_peered":"2026-02-13T01:25:37.627353+0000","last_clean":"2026-02-13T01:25:37.627353+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:37.627353+0000","last_undegraded":"2026-02-13T01:25:37.627353+0000","last_fullsized":"2026-02-13T01:25:37.627353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.564996+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:37.564996+0000","last_peered":"2026-02-13T01:25:37.564996+0000","last_clean":"2026-02-13T01:25:37.564996+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:37.564996+0000","last_undegraded":"2026-02-13T01:25:37.564996+0000","last_fullsized":"2026-02-13T01:25:37.564996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625239+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:37.625239+0000","last_peered":"2026-02-13T01:25:37.625239+0000","last_clean":"2026-02-13T01:25:37.625239+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:37.625239+0000","last_undegraded":"2026-02-13T01:25:37.625239+0000","last_fullsized":"2026-02-13T01:25:37.625239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139546+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:37.139546+0000","last_peered":"2026-02-13T01:25:37.139546+0000","last_clean":"2026-02-13T01:25:37.139546+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:37.139546+0000","last_undegraded":"2026-02-13T01:25:37.139546+0000","last_fullsized":"2026-02-13T01:25:37.139546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137542+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:37.137542+0000","last_peered":"2026-02-13T01:25:37.137542+0000","last_clean":"2026-02-13T01:25:37.137542+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:37.137542+0000","last_undegraded":"2026-02-13T01:25:37.137542+0000","last_fullsized":"2026-02-13T01:25:37.137542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139726+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:37.139726+0000","last_peered":"2026-02-13T01:25:37.139726+0000","last_clean":"2026-02-13T01:25:37.139726+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:37.139726+0000","last_undegraded":"2026-02-13T01:25:37.139726+0000","last_fullsized":"2026-02-13T01:25:37.139726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138125+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:37.138125+0000","last_peered":"2026-02-13T01:25:37.138125+0000","last_clean":"2026-02-13T01:25:37.138125+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:37.138125+0000","last_undegraded":"2026-02-13T01:25:37.138125+0000","last_fullsized":"2026-02-13T01:25:37.138125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.627436+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:37.627436+0000","last_peered":"2026-02-13T01:25:37.627436+0000","last_clean":"2026-02-13T01:25:37.627436+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:37.627436+0000","last_undegraded":"2026-02-13T01:25:37.627436+0000","last_fullsized":"2026-02-13T01:25:37.627436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565074+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:37.565074+0000","last_peered":"2026-02-13T01:25:37.565074+0000","last_clean":"2026-02-13T01:25:37.565074+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:37.565074+0000","last_undegraded":"2026-02-13T01:25:37.565074+0000","last_fullsized":"2026-02-13T01:25:37.565074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625038+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:37.625038+0000","last_peered":"2026-02-13T01:25:37.625038+0000","last_clean":"2026-02-13T01:25:37.625038+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:37.625038+0000","last_undegraded":"2026-02-13T01:25:37.625038+0000","last_fullsized":"2026-02-13T01:25:37.625038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138466+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:37.138466+0000","last_peered":"2026-02-13T01:25:37.138466+0000","last_clean":"2026-02-13T01:25:37.138466+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:37.138466+0000","last_undegraded":"2026-02-13T01:25:37.138466+0000","last_fullsized":"2026-02-13T01:25:37.138466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626922+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:37.626922+0000","last_peered":"2026-02-13T01:25:37.626922+0000","last_clean":"2026-02-13T01:25:37.626922+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:37.626922+0000","last_undegraded":"2026-02-13T01:25:37.626922+0000","last_fullsized":"2026-02-13T01:25:37.626922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.627049+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:37.627049+0000","last_peered":"2026-02-13T01:25:37.627049+0000","last_clean":"2026-02-13T01:25:37.627049+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:37.627049+0000","last_undegraded":"2026-02-13T01:25:37.627049+0000","last_fullsized":"2026-02-13T01:25:37.627049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.564946+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:37.564946+0000","last_peered":"2026-02-13T01:25:37.564946+0000","last_clean":"2026-02-13T01:25:37.564946+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:37.564946+0000","last_undegraded":"2026-02-13T01:25:37.564946+0000","last_fullsized":"2026-02-13T01:25:37.564946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422910+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:37.422910+0000","last_peered":"2026-02-13T01:25:37.422910+0000","last_clean":"2026-02-13T01:25:37.422910+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:37.422910+0000","last_undegraded":"2026-02-13T01:25:37.422910+0000","last_fullsized":"2026-02-13T01:25:37.422910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:41.878146+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:41.878146+0000","last_peered":"2026-02-13T01:25:41.878146+0000","last_clean":"2026-02-13T01:25:41.878146+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:41.878146+0000","last_undegraded":"2026-02-13T01:25:41.878146+0000","last_fullsized":"2026-02-13T01:25:41.878146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139835+0000","last_change":"2026-02-13T01:25:36.142121+0000","last_active":"2026-02-13T01:25:37.139835+0000","last_peered":"2026-02-13T01:25:37.139835+0000","last_clean":"2026-02-13T01:25:37.139835+0000","last_became_active":"2026-02-13T01:25:36.141933+0000","last_became_peered":"2026-02-13T01:25:36.141933+0000","last_unstale":"2026-02-13T01:25:37.139835+0000","last_undegraded":"2026-02-13T01:25:37.139835+0000","last_fullsized":"2026-02-13T01:25:37.139835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:33:18.809678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870260+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:39.870260+0000","last_peered":"2026-02-13T01:25:39.870260+0000","last_clean":"2026-02-13T01:25:39.870260+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:39.870260+0000","last_undegraded":"2026-02-13T01:25:39.870260+0000","last_fullsized":"2026-02-13T01:25:39.870260+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870098+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:39.870098+0000","last_peered":"2026-02-13T01:25:39.870098+0000","last_clean":"2026-02-13T01:25:39.870098+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:39.870098+0000","last_undegraded":"2026-02-13T01:25:39.870098+0000","last_fullsized":"2026-02-13T01:25:39.870098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137598+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:37.137598+0000","last_peered":"2026-02-13T01:25:37.137598+0000","last_clean":"2026-02-13T01:25:37.137598+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:37.137598+0000","last_undegraded":"2026-02-13T01:25:37.137598+0000","last_fullsized":"2026-02-13T01:25:37.137598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.747819+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:38.747819+0000","last_peered":"2026-02-13T01:25:38.747819+0000","last_clean":"2026-02-13T01:25:38.747819+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:38.747819+0000","last_undegraded":"2026-02-13T01:25:38.747819+0000","last_fullsized":"2026-02-13T01:25:38.747819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625004+0000","last_change":"2026-02-13T01:25:36.146598+0000","last_active":"2026-02-13T01:25:37.625004+0000","last_peered":"2026-02-13T01:25:37.625004+0000","last_clean":"2026-02-13T01:25:37.625004+0000","last_became_active":"2026-02-13T01:25:36.146372+0000","last_became_peered":"2026-02-13T01:25:36.146372+0000","last_unstale":"2026-02-13T01:25:37.625004+0000","last_undegraded":"2026-02-13T01:25:37.625004+0000","last_fullsized":"2026-02-13T01:25:37.625004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:40.191957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:40.876043+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:40.876043+0000","last_peered":"2026-02-13T01:25:40.876043+0000","last_clean":"2026-02-13T01:25:40.876043+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:40.876043+0000","last_undegraded":"2026-02-13T01:25:40.876043+0000","last_fullsized":"2026-02-13T01:25:40.876043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139568+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:37.139568+0000","last_peered":"2026-02-13T01:25:37.139568+0000","last_clean":"2026-02-13T01:25:37.139568+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:37.139568+0000","last_undegraded":"2026-02-13T01:25:37.139568+0000","last_fullsized":"2026-02-13T01:25:37.139568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.864831+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:38.864831+0000","last_peered":"2026-02-13T01:25:38.864831+0000","last_clean":"2026-02-13T01:25:38.864831+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:38.864831+0000","last_undegraded":"2026-02-13T01:25:38.864831+0000","last_fullsized":"2026-02-13T01:25:38.864831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138226+0000","last_change":"2026-02-13T01:25:36.142206+0000","last_active":"2026-02-13T01:25:37.138226+0000","last_peered":"2026-02-13T01:25:37.138226+0000","last_clean":"2026-02-13T01:25:37.138226+0000","last_became_active":"2026-02-13T01:25:36.141935+0000","last_became_peered":"2026-02-13T01:25:36.141935+0000","last_unstale":"2026-02-13T01:25:37.138226+0000","last_undegraded":"2026-02-13T01:25:37.138226+0000","last_fullsized":"2026-02-13T01:25:37.138226+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:10:38.419363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865843+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:38.865843+0000","last_peered":"2026-02-13T01:25:38.865843+0000","last_clean":"2026-02-13T01:25:38.865843+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:38.865843+0000","last_undegraded":"2026-02-13T01:25:38.865843+0000","last_fullsized":"2026-02-13T01:25:38.865843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139526+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:37.139526+0000","last_peered":"2026-02-13T01:25:37.139526+0000","last_clean":"2026-02-13T01:25:37.139526+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:37.139526+0000","last_undegraded":"2026-02-13T01:25:37.139526+0000","last_fullsized":"2026-02-13T01:25:37.139526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:42.122356+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:42.122356+0000","last_peered":"2026-02-13T01:25:42.122356+0000","last_clean":"2026-02-13T01:25:42.122356+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:42.122356+0000","last_undegraded":"2026-02-13T01:25:42.122356+0000","last_fullsized":"2026-02-13T01:25:42.122356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25594,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":17,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.423096+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:37.423096+0000","last_peered":"2026-02-13T01:25:37.423096+0000","last_clean":"2026-02-13T01:25:37.423096+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:37.423096+0000","last_undegraded":"2026-02-13T01:25:37.423096+0000","last_fullsized":"2026-02-13T01:25:37.423096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870466+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:39.870466+0000","last_peered":"2026-02-13T01:25:39.870466+0000","last_clean":"2026-02-13T01:25:39.870466+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:39.870466+0000","last_undegraded":"2026-02-13T01:25:39.870466+0000","last_fullsized":"2026-02-13T01:25:39.870466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624793+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:37.624793+0000","last_peered":"2026-02-13T01:25:37.624793+0000","last_clean":"2026-02-13T01:25:37.624793+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:37.624793+0000","last_undegraded":"2026-02-13T01:25:37.624793+0000","last_fullsized":"2026-02-13T01:25:37.624793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.867101+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:38.867101+0000","last_peered":"2026-02-13T01:25:38.867101+0000","last_clean":"2026-02-13T01:25:38.867101+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:38.867101+0000","last_undegraded":"2026-02-13T01:25:38.867101+0000","last_fullsized":"2026-02-13T01:25:38.867101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626187+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:37.626187+0000","last_peered":"2026-02-13T01:25:37.626187+0000","last_clean":"2026-02-13T01:25:37.626187+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:37.626187+0000","last_undegraded":"2026-02-13T01:25:37.626187+0000","last_fullsized":"2026-02-13T01:25:37.626187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870031+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:39.870031+0000","last_peered":"2026-02-13T01:25:39.870031+0000","last_clean":"2026-02-13T01:25:39.870031+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:39.870031+0000","last_undegraded":"2026-02-13T01:25:39.870031+0000","last_fullsized":"2026-02-13T01:25:39.870031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625989+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:37.625989+0000","last_peered":"2026-02-13T01:25:37.625989+0000","last_clean":"2026-02-13T01:25:37.625989+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:37.625989+0000","last_undegraded":"2026-02-13T01:25:37.625989+0000","last_fullsized":"2026-02-13T01:25:37.625989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.871415+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:39.871415+0000","last_peered":"2026-02-13T01:25:39.871415+0000","last_clean":"2026-02-13T01:25:39.871415+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:39.871415+0000","last_undegraded":"2026-02-13T01:25:39.871415+0000","last_fullsized":"2026-02-13T01:25:39.871415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139790+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:37.139790+0000","last_peered":"2026-02-13T01:25:37.139790+0000","last_clean":"2026-02-13T01:25:37.139790+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:37.139790+0000","last_undegraded":"2026-02-13T01:25:37.139790+0000","last_fullsized":"2026-02-13T01:25:37.139790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:40.874843+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:40.874843+0000","last_peered":"2026-02-13T01:25:40.874843+0000","last_clean":"2026-02-13T01:25:40.874843+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:40.874843+0000","last_undegraded":"2026-02-13T01:25:40.874843+0000","last_fullsized":"2026-02-13T01:25:40.874843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565069+0000","last_change":"2026-02-13T01:25:36.138391+0000","last_active":"2026-02-13T01:25:37.565069+0000","last_peered":"2026-02-13T01:25:37.565069+0000","last_clean":"2026-02-13T01:25:37.565069+0000","last_became_active":"2026-02-13T01:25:36.138102+0000","last_became_peered":"2026-02-13T01:25:36.138102+0000","last_unstale":"2026-02-13T01:25:37.565069+0000","last_undegraded":"2026-02-13T01:25:37.565069+0000","last_fullsized":"2026-02-13T01:25:37.565069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:42:59.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624993+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:37.624993+0000","last_peered":"2026-02-13T01:25:37.624993+0000","last_clean":"2026-02-13T01:25:37.624993+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:37.624993+0000","last_undegraded":"2026-02-13T01:25:37.624993+0000","last_fullsized":"2026-02-13T01:25:37.624993+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626325+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:37.626325+0000","last_peered":"2026-02-13T01:25:37.626325+0000","last_clean":"2026-02-13T01:25:37.626325+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:37.626325+0000","last_undegraded":"2026-02-13T01:25:37.626325+0000","last_fullsized":"2026-02-13T01:25:37.626325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.747887+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:38.747887+0000","last_peered":"2026-02-13T01:25:38.747887+0000","last_clean":"2026-02-13T01:25:38.747887+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:38.747887+0000","last_undegraded":"2026-02-13T01:25:38.747887+0000","last_fullsized":"2026-02-13T01:25:38.747887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626189+0000","last_change":"2026-02-13T01:25:36.140994+0000","last_active":"2026-02-13T01:25:37.626189+0000","last_peered":"2026-02-13T01:25:37.626189+0000","last_clean":"2026-02-13T01:25:37.626189+0000","last_became_active":"2026-02-13T01:25:36.140854+0000","last_became_peered":"2026-02-13T01:25:36.140854+0000","last_unstale":"2026-02-13T01:25:37.626189+0000","last_undegraded":"2026-02-13T01:25:37.626189+0000","last_fullsized":"2026-02-13T01:25:37.626189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:44.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870629+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:39.870629+0000","last_peered":"2026-02-13T01:25:39.870629+0000","last_clean":"2026-02-13T01:25:39.870629+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:39.870629+0000","last_undegraded":"2026-02-13T01:25:39.870629+0000","last_fullsized":"2026-02-13T01:25:39.870629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626265+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:37.626265+0000","last_peered":"2026-02-13T01:25:37.626265+0000","last_clean":"2026-02-13T01:25:37.626265+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:37.626265+0000","last_undegraded":"2026-02-13T01:25:37.626265+0000","last_fullsized":"2026-02-13T01:25:37.626265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626049+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:37.626049+0000","last_peered":"2026-02-13T01:25:37.626049+0000","last_clean":"2026-02-13T01:25:37.626049+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:37.626049+0000","last_undegraded":"2026-02-13T01:25:37.626049+0000","last_fullsized":"2026-02-13T01:25:37.626049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865955+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:38.865955+0000","last_peered":"2026-02-13T01:25:38.865955+0000","last_clean":"2026-02-13T01:25:38.865955+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:38.865955+0000","last_undegraded":"2026-02-13T01:25:38.865955+0000","last_fullsized":"2026-02-13T01:25:38.865955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137726+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:37.137726+0000","last_peered":"2026-02-13T01:25:37.137726+0000","last_clean":"2026-02-13T01:25:37.137726+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:37.137726+0000","last_undegraded":"2026-02-13T01:25:37.137726+0000","last_fullsized":"2026-02-13T01:25:37.137726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870335+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:39.870335+0000","last_peered":"2026-02-13T01:25:39.870335+0000","last_clean":"2026-02-13T01:25:39.870335+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:39.870335+0000","last_undegraded":"2026-02-13T01:25:39.870335+0000","last_fullsized":"2026-02-13T01:25:39.870335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624724+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:37.624724+0000","last_peered":"2026-02-13T01:25:37.624724+0000","last_clean":"2026-02-13T01:25:37.624724+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:37.624724+0000","last_undegraded":"2026-02-13T01:25:37.624724+0000","last_fullsized":"2026-02-13T01:25:37.624724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:41.877386+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:41.877386+0000","last_peered":"2026-02-13T01:25:41.877386+0000","last_clean":"2026-02-13T01:25:41.877386+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:41.877386+0000","last_undegraded":"2026-02-13T01:25:41.877386+0000","last_fullsized":"2026-02-13T01:25:41.877386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139859+0000","last_change":"2026-02-13T01:25:36.139130+0000","last_active":"2026-02-13T01:25:37.139859+0000","last_peered":"2026-02-13T01:25:37.139859+0000","last_clean":"2026-02-13T01:25:37.139859+0000","last_became_active":"2026-02-13T01:25:36.138947+0000","last_became_peered":"2026-02-13T01:25:36.138947+0000","last_unstale":"2026-02-13T01:25:37.139859+0000","last_undegraded":"2026-02-13T01:25:37.139859+0000","last_fullsized":"2026-02-13T01:25:37.139859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:30:19.260251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626111+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:37.626111+0000","last_peered":"2026-02-13T01:25:37.626111+0000","last_clean":"2026-02-13T01:25:37.626111+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:37.626111+0000","last_undegraded":"2026-02-13T01:25:37.626111+0000","last_fullsized":"2026-02-13T01:25:37.626111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139341+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:37.139341+0000","last_peered":"2026-02-13T01:25:37.139341+0000","last_clean":"2026-02-13T01:25:37.139341+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:37.139341+0000","last_undegraded":"2026-02-13T01:25:37.139341+0000","last_fullsized":"2026-02-13T01:25:37.139341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624829+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:37.624829+0000","last_peered":"2026-02-13T01:25:37.624829+0000","last_clean":"2026-02-13T01:25:37.624829+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:37.624829+0000","last_undegraded":"2026-02-13T01:25:37.624829+0000","last_fullsized":"2026-02-13T01:25:37.624829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.807485+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:37.807485+0000","last_peered":"2026-02-13T01:25:37.807485+0000","last_clean":"2026-02-13T01:25:37.807485+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:37.807485+0000","last_undegraded":"2026-02-13T01:25:37.807485+0000","last_fullsized":"2026-02-13T01:25:37.807485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865905+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:38.865905+0000","last_peered":"2026-02-13T01:25:38.865905+0000","last_clean":"2026-02-13T01:25:38.865905+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:38.865905+0000","last_undegraded":"2026-02-13T01:25:38.865905+0000","last_fullsized":"2026-02-13T01:25:38.865905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625087+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:37.625087+0000","last_peered":"2026-02-13T01:25:37.625087+0000","last_clean":"2026-02-13T01:25:37.625087+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:37.625087+0000","last_undegraded":"2026-02-13T01:25:37.625087+0000","last_fullsized":"2026-02-13T01:25:37.625087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625108+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:37.625108+0000","last_peered":"2026-02-13T01:25:37.625108+0000","last_clean":"2026-02-13T01:25:37.625108+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:37.625108+0000","last_undegraded":"2026-02-13T01:25:37.625108+0000","last_fullsized":"2026-02-13T01:25:37.625108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138224+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:37.138224+0000","last_peered":"2026-02-13T01:25:37.138224+0000","last_clean":"2026-02-13T01:25:37.138224+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:37.138224+0000","last_undegraded":"2026-02-13T01:25:37.138224+0000","last_fullsized":"2026-02-13T01:25:37.138224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865213+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:38.865213+0000","last_peered":"2026-02-13T01:25:38.865213+0000","last_clean":"2026-02-13T01:25:38.865213+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:38.865213+0000","last_undegraded":"2026-02-13T01:25:38.865213+0000","last_fullsized":"2026-02-13T01:25:38.865213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138050+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:37.138050+0000","last_peered":"2026-02-13T01:25:37.138050+0000","last_clean":"2026-02-13T01:25:37.138050+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:37.138050+0000","last_undegraded":"2026-02-13T01:25:37.138050+0000","last_fullsized":"2026-02-13T01:25:37.138050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.864744+0000","last_change":"2026-02-13T01:25:35.141373+0000","last_active":"2026-02-13T01:25:38.864744+0000","last_peered":"2026-02-13T01:25:38.864744+0000","last_clean":"2026-02-13T01:25:38.864744+0000","last_became_active":"2026-02-13T01:25:35.141256+0000","last_became_peered":"2026-02-13T01:25:35.141256+0000","last_unstale":"2026-02-13T01:25:38.864744+0000","last_undegraded":"2026-02-13T01:25:38.864744+0000","last_fullsized":"2026-02-13T01:25:38.864744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:51:59.454888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422820+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:37.422820+0000","last_peered":"2026-02-13T01:25:37.422820+0000","last_clean":"2026-02-13T01:25:37.422820+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:37.422820+0000","last_undegraded":"2026-02-13T01:25:37.422820+0000","last_fullsized":"2026-02-13T01:25:37.422820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.864934+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:38.864934+0000","last_peered":"2026-02-13T01:25:38.864934+0000","last_clean":"2026-02-13T01:25:38.864934+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:38.864934+0000","last_undegraded":"2026-02-13T01:25:38.864934+0000","last_fullsized":"2026-02-13T01:25:38.864934+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565021+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:37.565021+0000","last_peered":"2026-02-13T01:25:37.565021+0000","last_clean":"2026-02-13T01:25:37.565021+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:37.565021+0000","last_undegraded":"2026-02-13T01:25:37.565021+0000","last_fullsized":"2026-02-13T01:25:37.565021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626887+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:37.626887+0000","last_peered":"2026-02-13T01:25:37.626887+0000","last_clean":"2026-02-13T01:25:37.626887+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:37.626887+0000","last_undegraded":"2026-02-13T01:25:37.626887+0000","last_fullsized":"2026-02-13T01:25:37.626887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138003+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:37.138003+0000","last_peered":"2026-02-13T01:25:37.138003+0000","last_clean":"2026-02-13T01:25:37.138003+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:37.138003+0000","last_undegraded":"2026-02-13T01:25:37.138003+0000","last_fullsized":"2026-02-13T01:25:37.138003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865803+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:38.865803+0000","last_peered":"2026-02-13T01:25:38.865803+0000","last_clean":"2026-02-13T01:25:38.865803+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:38.865803+0000","last_undegraded":"2026-02-13T01:25:38.865803+0000","last_fullsized":"2026-02-13T01:25:38.865803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626216+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:37.626216+0000","last_peered":"2026-02-13T01:25:37.626216+0000","last_clean":"2026-02-13T01:25:37.626216+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:37.626216+0000","last_undegraded":"2026-02-13T01:25:37.626216+0000","last_fullsized":"2026-02-13T01:25:37.626216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139916+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:37.139916+0000","last_peered":"2026-02-13T01:25:37.139916+0000","last_clean":"2026-02-13T01:25:37.139916+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:37.139916+0000","last_undegraded":"2026-02-13T01:25:37.139916+0000","last_fullsized":"2026-02-13T01:25:37.139916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422975+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:37.422975+0000","last_peered":"2026-02-13T01:25:37.422975+0000","last_clean":"2026-02-13T01:25:37.422975+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:37.422975+0000","last_undegraded":"2026-02-13T01:25:37.422975+0000","last_fullsized":"2026-02-13T01:25:37.422975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139473+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:37.139473+0000","last_peered":"2026-02-13T01:25:37.139473+0000","last_clean":"2026-02-13T01:25:37.139473+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:37.139473+0000","last_undegraded":"2026-02-13T01:25:37.139473+0000","last_fullsized":"2026-02-13T01:25:37.139473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.869934+0000","last_change":"2026-02-13T01:25:35.134307+0000","last_active":"2026-02-13T01:25:39.869934+0000","last_peered":"2026-02-13T01:25:39.869934+0000","last_clean":"2026-02-13T01:25:39.869934+0000","last_became_active":"2026-02-13T01:25:35.134066+0000","last_became_peered":"2026-02-13T01:25:35.134066+0000","last_unstale":"2026-02-13T01:25:39.869934+0000","last_undegraded":"2026-02-13T01:25:39.869934+0000","last_fullsized":"2026-02-13T01:25:39.869934+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:37:51.552569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138180+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:37.138180+0000","last_peered":"2026-02-13T01:25:37.138180+0000","last_clean":"2026-02-13T01:25:37.138180+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:37.138180+0000","last_undegraded":"2026-02-13T01:25:37.138180+0000","last_fullsized":"2026-02-13T01:25:37.138180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.112048+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:38.112048+0000","last_peered":"2026-02-13T01:25:38.112048+0000","last_clean":"2026-02-13T01:25:38.112048+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:38.112048+0000","last_undegraded":"2026-02-13T01:25:38.112048+0000","last_fullsized":"2026-02-13T01:25:38.112048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138050+0000","last_change":"2026-02-13T01:25:36.146673+0000","last_active":"2026-02-13T01:25:37.138050+0000","last_peered":"2026-02-13T01:25:37.138050+0000","last_clean":"2026-02-13T01:25:37.138050+0000","last_became_active":"2026-02-13T01:25:36.146557+0000","last_became_peered":"2026-02-13T01:25:36.146557+0000","last_unstale":"2026-02-13T01:25:37.138050+0000","last_undegraded":"2026-02-13T01:25:37.138050+0000","last_fullsized":"2026-02-13T01:25:37.138050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:02.339039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625096+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:37.625096+0000","last_peered":"2026-02-13T01:25:37.625096+0000","last_clean":"2026-02-13T01:25:37.625096+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:37.625096+0000","last_undegraded":"2026-02-13T01:25:37.625096+0000","last_fullsized":"2026-02-13T01:25:37.625096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":29680,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":27,"num_read_kb":28,"num_write":125,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":47427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153761,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710726,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":380774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6234,"internal_metadata":27584422},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27840,"kb_used_data":876,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975360,"statfs":{"total":751619276800,"available":751590768640,"internally_reserved":0,"allocated":897024,"data_stored":981127,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":381580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22449,"internal_metadata":27568207},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299405,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31260,"internal_metadata":27559396},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528333,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":972956,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19473,"internal_metadata":27571183},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":380981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27075,"internal_metadata":27563581},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920786,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":973167,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32722,"internal_metadata":27557934},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051602,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27748,"kb_used_data":784,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975452,"statfs":{"total":751619276800,"available":751590862848,"internally_reserved":0,"allocated":802816,"data_stored":380796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40270,"internal_metadata":27550386},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280532,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47286,"internal_metadata":27543370},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":57,"kb_used_meta":26886,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":383780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58910,"internal_metadata":27531746},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640280,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":382408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44971,"internal_metadata":27545685},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771097,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":382296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46012,"internal_metadata":27544644},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2298,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":10167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33338,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28990,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10937,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4078,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2784,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8204,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27161,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8313,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23561,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:45.991 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:46.174 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:46.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.367+0000 7f5362ea36c0 1 -- 10.20.193.28:0/2558004387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c10f060 msgr2=0x7f535c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.367+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/2558004387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c10f060 0x7f535c10f430 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=9952877960111201488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f534c0099a0 tx=0x7f534c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:46.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 -- 10.20.193.28:0/2558004387 shutdown_connections 2026-02-13T01:25:46.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/2558004387 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f535c10fa50 0x7f535c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/2558004387 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f535c115270 0x7f535c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/2558004387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c10f060 0x7f535c10f430 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=9952877960111201488 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 -- 10.20.193.28:0/2558004387 >> 10.20.193.28:0/2558004387 conn(0x7f535c0ec980 msgr2=0x7f535c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:46.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 -- 10.20.193.28:0/2558004387 shutdown_connections 2026-02-13T01:25:46.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.368+0000 7f5362ea36c0 1 -- 10.20.193.28:0/2558004387 wait complete. 2026-02-13T01:25:46.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 Processor -- start 2026-02-13T01:25:46.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 -- start start 2026-02-13T01:25:46.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f535c10f060 0x7f535c11d050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f535c115270 0x7f535c11d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 0x7f535c122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f535c123360 con 0x7f535c122950 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1234d0 con 0x7f535c10f060 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.369+0000 7f5362ea36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f535c123690 con 0x7f535c115270 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 0x7f535c122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 0x7f535c122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56484/0 (socket says 10.20.193.28:56484) 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 -- 10.20.193.28:0/3134016692 learned_addr learned my addr 10.20.193.28:0/3134016692 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f5361ea16c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f535c10f060 0x7f535c11d050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53616a06c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f535c115270 0x7f535c11d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 -- 10.20.193.28:0/3134016692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f535c115270 msgr2=0x7f535c11d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f535c115270 0x7f535c11d590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 -- 10.20.193.28:0/3134016692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f535c10f060 msgr2=0x7f535c11d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f535c10f060 0x7f535c11d050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 -- 10.20.193.28:0/3134016692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c009590 con 0x7f535c122950 2026-02-13T01:25:46.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f53626a26c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 0x7f535c122df0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5358006ea0 tx=0x7f535800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:46.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5358003a30 con 0x7f535c122950 2026-02-13T01:25:46.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5358005510 con 0x7f535c122950 2026-02-13T01:25:46.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f535800dd70 con 0x7f535c122950 2026-02-13T01:25:46.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c163b40 con 0x7f535c122950 2026-02-13T01:25:46.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.370+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c163fd0 con 0x7f535c122950 2026-02-13T01:25:46.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.371+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c110330 con 0x7f535c122950 2026-02-13T01:25:46.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.373+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f5358003b90 con 0x7f535c122950 2026-02-13T01:25:46.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.375+0000 7f534affd6c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f53380b5710 0x7f53380d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:46.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.375+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7f53580e4be0 con 0x7f535c122950 2026-02-13T01:25:46.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.375+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f535811d640 con 0x7f535c122950 2026-02-13T01:25:46.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.375+0000 7f5361ea16c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f53380b5710 0x7f53380d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:46.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.376+0000 7f5361ea16c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f53380b5710 0x7f53380d5bc0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f534c0092e0 tx=0x7f534c005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:46.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:46 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3107527587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:46.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:46 trial028 ceph-mon[22984]: from='client.24724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:46.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.475+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f535c10fa50 con 0x7f53380b5710 2026-02-13T01:25:46.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.479+0000 7f534affd6c0 1 -- 10.20.193.28:0/3134016692 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258931 (secure 0 0 0) 0x7f535c10fa50 con 0x7f53380b5710 2026-02-13T01:25:46.482 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:46.484 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:46.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.481+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f53380b5710 msgr2=0x7f53380d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.481+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f53380b5710 0x7f53380d5bc0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f534c0092e0 tx=0x7f534c005c00 comp rx=0 tx=0).stop 2026-02-13T01:25:46.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.481+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 msgr2=0x7f535c122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:46.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.481+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 0x7f535c122df0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5358006ea0 tx=0x7f535800cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 shutdown_connections 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f53380b5710 0x7f53380d5bc0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f535c115270 0x7f535c11d590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f535c122950 0x7f535c122df0 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 --2- 10.20.193.28:0/3134016692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f535c10f060 0x7f535c11d050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 >> 10.20.193.28:0/3134016692 conn(0x7f535c0ec980 msgr2=0x7f535c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 shutdown_connections 2026-02-13T01:25:46.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:46.482+0000 7f5362ea36c0 1 -- 10.20.193.28:0/3134016692 wait complete. 2026-02-13T01:25:46.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:46 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3107527587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:46.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:46 trial134 ceph-mon[27948]: from='client.24724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:46.618 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2026-02-13T01:25:44.700132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620165,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":315,"num_write_kb":3786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":264,"ondisk_log_size":264,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333312,"kb_used_data":9744,"kb_used_omap":394,"kb_used_meta":322933,"kb_avail":8807705088,"statfs":{"total":9019431321600,"available":9019090010112,"internally_reserved":0,"allocated":9977856,"data_stored":6362574,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":404157,"internal_metadata":330683715},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29797,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":27,"num_read_kb":28,"num_write":126,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.573005"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565113+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:37.565113+0000","last_peered":"2026-02-13T01:25:37.565113+0000","last_clean":"2026-02-13T01:25:37.565113+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:37.565113+0000","last_undegraded":"2026-02-13T01:25:37.565113+0000","last_fullsized":"2026-02-13T01:25:37.565113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137998+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:37.137998+0000","last_peered":"2026-02-13T01:25:37.137998+0000","last_clean":"2026-02-13T01:25:37.137998+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:37.137998+0000","last_undegraded":"2026-02-13T01:25:37.137998+0000","last_fullsized":"2026-02-13T01:25:37.137998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137793+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:37.137793+0000","last_peered":"2026-02-13T01:25:37.137793+0000","last_clean":"2026-02-13T01:25:37.137793+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:37.137793+0000","last_undegraded":"2026-02-13T01:25:37.137793+0000","last_fullsized":"2026-02-13T01:25:37.137793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626362+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:37.626362+0000","last_peered":"2026-02-13T01:25:37.626362+0000","last_clean":"2026-02-13T01:25:37.626362+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:37.626362+0000","last_undegraded":"2026-02-13T01:25:37.626362+0000","last_fullsized":"2026-02-13T01:25:37.626362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422868+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:37.422868+0000","last_peered":"2026-02-13T01:25:37.422868+0000","last_clean":"2026-02-13T01:25:37.422868+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:37.422868+0000","last_undegraded":"2026-02-13T01:25:37.422868+0000","last_fullsized":"2026-02-13T01:25:37.422868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139220+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:37.139220+0000","last_peered":"2026-02-13T01:25:37.139220+0000","last_clean":"2026-02-13T01:25:37.139220+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:37.139220+0000","last_undegraded":"2026-02-13T01:25:37.139220+0000","last_fullsized":"2026-02-13T01:25:37.139220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626030+0000","last_change":"2026-02-13T01:25:36.136782+0000","last_active":"2026-02-13T01:25:37.626030+0000","last_peered":"2026-02-13T01:25:37.626030+0000","last_clean":"2026-02-13T01:25:37.626030+0000","last_became_active":"2026-02-13T01:25:36.136618+0000","last_became_peered":"2026-02-13T01:25:36.136618+0000","last_unstale":"2026-02-13T01:25:37.626030+0000","last_undegraded":"2026-02-13T01:25:37.626030+0000","last_fullsized":"2026-02-13T01:25:37.626030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:20.569294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137610+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:37.137610+0000","last_peered":"2026-02-13T01:25:37.137610+0000","last_clean":"2026-02-13T01:25:37.137610+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:37.137610+0000","last_undegraded":"2026-02-13T01:25:37.137610+0000","last_fullsized":"2026-02-13T01:25:37.137610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139626+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:37.139626+0000","last_peered":"2026-02-13T01:25:37.139626+0000","last_clean":"2026-02-13T01:25:37.139626+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:37.139626+0000","last_undegraded":"2026-02-13T01:25:37.139626+0000","last_fullsized":"2026-02-13T01:25:37.139626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139632+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:37.139632+0000","last_peered":"2026-02-13T01:25:37.139632+0000","last_clean":"2026-02-13T01:25:37.139632+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:37.139632+0000","last_undegraded":"2026-02-13T01:25:37.139632+0000","last_fullsized":"2026-02-13T01:25:37.139632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626265+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:37.626265+0000","last_peered":"2026-02-13T01:25:37.626265+0000","last_clean":"2026-02-13T01:25:37.626265+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:37.626265+0000","last_undegraded":"2026-02-13T01:25:37.626265+0000","last_fullsized":"2026-02-13T01:25:37.626265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626410+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:37.626410+0000","last_peered":"2026-02-13T01:25:37.626410+0000","last_clean":"2026-02-13T01:25:37.626410+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:37.626410+0000","last_undegraded":"2026-02-13T01:25:37.626410+0000","last_fullsized":"2026-02-13T01:25:37.626410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625193+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:37.625193+0000","last_peered":"2026-02-13T01:25:37.625193+0000","last_clean":"2026-02-13T01:25:37.625193+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:37.625193+0000","last_undegraded":"2026-02-13T01:25:37.625193+0000","last_fullsized":"2026-02-13T01:25:37.625193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138324+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:37.138324+0000","last_peered":"2026-02-13T01:25:37.138324+0000","last_clean":"2026-02-13T01:25:37.138324+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:37.138324+0000","last_undegraded":"2026-02-13T01:25:37.138324+0000","last_fullsized":"2026-02-13T01:25:37.138324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138245+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:37.138245+0000","last_peered":"2026-02-13T01:25:37.138245+0000","last_clean":"2026-02-13T01:25:37.138245+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:37.138245+0000","last_undegraded":"2026-02-13T01:25:37.138245+0000","last_fullsized":"2026-02-13T01:25:37.138245+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139321+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:37.139321+0000","last_peered":"2026-02-13T01:25:37.139321+0000","last_clean":"2026-02-13T01:25:37.139321+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:37.139321+0000","last_undegraded":"2026-02-13T01:25:37.139321+0000","last_fullsized":"2026-02-13T01:25:37.139321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565131+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:37.565131+0000","last_peered":"2026-02-13T01:25:37.565131+0000","last_clean":"2026-02-13T01:25:37.565131+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:37.565131+0000","last_undegraded":"2026-02-13T01:25:37.565131+0000","last_fullsized":"2026-02-13T01:25:37.565131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625069+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:37.625069+0000","last_peered":"2026-02-13T01:25:37.625069+0000","last_clean":"2026-02-13T01:25:37.625069+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:37.625069+0000","last_undegraded":"2026-02-13T01:25:37.625069+0000","last_fullsized":"2026-02-13T01:25:37.625069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.627353+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:37.627353+0000","last_peered":"2026-02-13T01:25:37.627353+0000","last_clean":"2026-02-13T01:25:37.627353+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:37.627353+0000","last_undegraded":"2026-02-13T01:25:37.627353+0000","last_fullsized":"2026-02-13T01:25:37.627353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.564996+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:37.564996+0000","last_peered":"2026-02-13T01:25:37.564996+0000","last_clean":"2026-02-13T01:25:37.564996+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:37.564996+0000","last_undegraded":"2026-02-13T01:25:37.564996+0000","last_fullsized":"2026-02-13T01:25:37.564996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625239+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:37.625239+0000","last_peered":"2026-02-13T01:25:37.625239+0000","last_clean":"2026-02-13T01:25:37.625239+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:37.625239+0000","last_undegraded":"2026-02-13T01:25:37.625239+0000","last_fullsized":"2026-02-13T01:25:37.625239+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139546+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:37.139546+0000","last_peered":"2026-02-13T01:25:37.139546+0000","last_clean":"2026-02-13T01:25:37.139546+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:37.139546+0000","last_undegraded":"2026-02-13T01:25:37.139546+0000","last_fullsized":"2026-02-13T01:25:37.139546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137542+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:37.137542+0000","last_peered":"2026-02-13T01:25:37.137542+0000","last_clean":"2026-02-13T01:25:37.137542+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:37.137542+0000","last_undegraded":"2026-02-13T01:25:37.137542+0000","last_fullsized":"2026-02-13T01:25:37.137542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139726+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:37.139726+0000","last_peered":"2026-02-13T01:25:37.139726+0000","last_clean":"2026-02-13T01:25:37.139726+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:37.139726+0000","last_undegraded":"2026-02-13T01:25:37.139726+0000","last_fullsized":"2026-02-13T01:25:37.139726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138125+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:37.138125+0000","last_peered":"2026-02-13T01:25:37.138125+0000","last_clean":"2026-02-13T01:25:37.138125+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:37.138125+0000","last_undegraded":"2026-02-13T01:25:37.138125+0000","last_fullsized":"2026-02-13T01:25:37.138125+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.627436+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:37.627436+0000","last_peered":"2026-02-13T01:25:37.627436+0000","last_clean":"2026-02-13T01:25:37.627436+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:37.627436+0000","last_undegraded":"2026-02-13T01:25:37.627436+0000","last_fullsized":"2026-02-13T01:25:37.627436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565074+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:37.565074+0000","last_peered":"2026-02-13T01:25:37.565074+0000","last_clean":"2026-02-13T01:25:37.565074+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:37.565074+0000","last_undegraded":"2026-02-13T01:25:37.565074+0000","last_fullsized":"2026-02-13T01:25:37.565074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625038+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:37.625038+0000","last_peered":"2026-02-13T01:25:37.625038+0000","last_clean":"2026-02-13T01:25:37.625038+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:37.625038+0000","last_undegraded":"2026-02-13T01:25:37.625038+0000","last_fullsized":"2026-02-13T01:25:37.625038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138466+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:37.138466+0000","last_peered":"2026-02-13T01:25:37.138466+0000","last_clean":"2026-02-13T01:25:37.138466+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:37.138466+0000","last_undegraded":"2026-02-13T01:25:37.138466+0000","last_fullsized":"2026-02-13T01:25:37.138466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626922+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:37.626922+0000","last_peered":"2026-02-13T01:25:37.626922+0000","last_clean":"2026-02-13T01:25:37.626922+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:37.626922+0000","last_undegraded":"2026-02-13T01:25:37.626922+0000","last_fullsized":"2026-02-13T01:25:37.626922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.627049+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:37.627049+0000","last_peered":"2026-02-13T01:25:37.627049+0000","last_clean":"2026-02-13T01:25:37.627049+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:37.627049+0000","last_undegraded":"2026-02-13T01:25:37.627049+0000","last_fullsized":"2026-02-13T01:25:37.627049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.564946+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:37.564946+0000","last_peered":"2026-02-13T01:25:37.564946+0000","last_clean":"2026-02-13T01:25:37.564946+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:37.564946+0000","last_undegraded":"2026-02-13T01:25:37.564946+0000","last_fullsized":"2026-02-13T01:25:37.564946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422910+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:37.422910+0000","last_peered":"2026-02-13T01:25:37.422910+0000","last_clean":"2026-02-13T01:25:37.422910+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:37.422910+0000","last_undegraded":"2026-02-13T01:25:37.422910+0000","last_fullsized":"2026-02-13T01:25:37.422910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:41.878146+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:41.878146+0000","last_peered":"2026-02-13T01:25:41.878146+0000","last_clean":"2026-02-13T01:25:41.878146+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:41.878146+0000","last_undegraded":"2026-02-13T01:25:41.878146+0000","last_fullsized":"2026-02-13T01:25:41.878146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139835+0000","last_change":"2026-02-13T01:25:36.142121+0000","last_active":"2026-02-13T01:25:37.139835+0000","last_peered":"2026-02-13T01:25:37.139835+0000","last_clean":"2026-02-13T01:25:37.139835+0000","last_became_active":"2026-02-13T01:25:36.141933+0000","last_became_peered":"2026-02-13T01:25:36.141933+0000","last_unstale":"2026-02-13T01:25:37.139835+0000","last_undegraded":"2026-02-13T01:25:37.139835+0000","last_fullsized":"2026-02-13T01:25:37.139835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:33:18.809678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870260+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:39.870260+0000","last_peered":"2026-02-13T01:25:39.870260+0000","last_clean":"2026-02-13T01:25:39.870260+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:39.870260+0000","last_undegraded":"2026-02-13T01:25:39.870260+0000","last_fullsized":"2026-02-13T01:25:39.870260+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870098+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:39.870098+0000","last_peered":"2026-02-13T01:25:39.870098+0000","last_clean":"2026-02-13T01:25:39.870098+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:39.870098+0000","last_undegraded":"2026-02-13T01:25:39.870098+0000","last_fullsized":"2026-02-13T01:25:39.870098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137598+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:37.137598+0000","last_peered":"2026-02-13T01:25:37.137598+0000","last_clean":"2026-02-13T01:25:37.137598+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:37.137598+0000","last_undegraded":"2026-02-13T01:25:37.137598+0000","last_fullsized":"2026-02-13T01:25:37.137598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.747819+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:38.747819+0000","last_peered":"2026-02-13T01:25:38.747819+0000","last_clean":"2026-02-13T01:25:38.747819+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:38.747819+0000","last_undegraded":"2026-02-13T01:25:38.747819+0000","last_fullsized":"2026-02-13T01:25:38.747819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625004+0000","last_change":"2026-02-13T01:25:36.146598+0000","last_active":"2026-02-13T01:25:37.625004+0000","last_peered":"2026-02-13T01:25:37.625004+0000","last_clean":"2026-02-13T01:25:37.625004+0000","last_became_active":"2026-02-13T01:25:36.146372+0000","last_became_peered":"2026-02-13T01:25:36.146372+0000","last_unstale":"2026-02-13T01:25:37.625004+0000","last_undegraded":"2026-02-13T01:25:37.625004+0000","last_fullsized":"2026-02-13T01:25:37.625004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:40.191957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:40.876043+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:40.876043+0000","last_peered":"2026-02-13T01:25:40.876043+0000","last_clean":"2026-02-13T01:25:40.876043+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:40.876043+0000","last_undegraded":"2026-02-13T01:25:40.876043+0000","last_fullsized":"2026-02-13T01:25:40.876043+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139568+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:37.139568+0000","last_peered":"2026-02-13T01:25:37.139568+0000","last_clean":"2026-02-13T01:25:37.139568+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:37.139568+0000","last_undegraded":"2026-02-13T01:25:37.139568+0000","last_fullsized":"2026-02-13T01:25:37.139568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.864831+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:38.864831+0000","last_peered":"2026-02-13T01:25:38.864831+0000","last_clean":"2026-02-13T01:25:38.864831+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:38.864831+0000","last_undegraded":"2026-02-13T01:25:38.864831+0000","last_fullsized":"2026-02-13T01:25:38.864831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138226+0000","last_change":"2026-02-13T01:25:36.142206+0000","last_active":"2026-02-13T01:25:37.138226+0000","last_peered":"2026-02-13T01:25:37.138226+0000","last_clean":"2026-02-13T01:25:37.138226+0000","last_became_active":"2026-02-13T01:25:36.141935+0000","last_became_peered":"2026-02-13T01:25:36.141935+0000","last_unstale":"2026-02-13T01:25:37.138226+0000","last_undegraded":"2026-02-13T01:25:37.138226+0000","last_fullsized":"2026-02-13T01:25:37.138226+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:10:38.419363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865843+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:38.865843+0000","last_peered":"2026-02-13T01:25:38.865843+0000","last_clean":"2026-02-13T01:25:38.865843+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:38.865843+0000","last_undegraded":"2026-02-13T01:25:38.865843+0000","last_fullsized":"2026-02-13T01:25:38.865843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139526+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:37.139526+0000","last_peered":"2026-02-13T01:25:37.139526+0000","last_clean":"2026-02-13T01:25:37.139526+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:37.139526+0000","last_undegraded":"2026-02-13T01:25:37.139526+0000","last_fullsized":"2026-02-13T01:25:37.139526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:42.122356+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:42.122356+0000","last_peered":"2026-02-13T01:25:42.122356+0000","last_clean":"2026-02-13T01:25:42.122356+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:42.122356+0000","last_undegraded":"2026-02-13T01:25:42.122356+0000","last_fullsized":"2026-02-13T01:25:42.122356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25594,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":17,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.423096+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:37.423096+0000","last_peered":"2026-02-13T01:25:37.423096+0000","last_clean":"2026-02-13T01:25:37.423096+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:37.423096+0000","last_undegraded":"2026-02-13T01:25:37.423096+0000","last_fullsized":"2026-02-13T01:25:37.423096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870466+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:39.870466+0000","last_peered":"2026-02-13T01:25:39.870466+0000","last_clean":"2026-02-13T01:25:39.870466+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:39.870466+0000","last_undegraded":"2026-02-13T01:25:39.870466+0000","last_fullsized":"2026-02-13T01:25:39.870466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624793+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:37.624793+0000","last_peered":"2026-02-13T01:25:37.624793+0000","last_clean":"2026-02-13T01:25:37.624793+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:37.624793+0000","last_undegraded":"2026-02-13T01:25:37.624793+0000","last_fullsized":"2026-02-13T01:25:37.624793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.867101+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:38.867101+0000","last_peered":"2026-02-13T01:25:38.867101+0000","last_clean":"2026-02-13T01:25:38.867101+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:38.867101+0000","last_undegraded":"2026-02-13T01:25:38.867101+0000","last_fullsized":"2026-02-13T01:25:38.867101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626187+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:37.626187+0000","last_peered":"2026-02-13T01:25:37.626187+0000","last_clean":"2026-02-13T01:25:37.626187+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:37.626187+0000","last_undegraded":"2026-02-13T01:25:37.626187+0000","last_fullsized":"2026-02-13T01:25:37.626187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870031+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:39.870031+0000","last_peered":"2026-02-13T01:25:39.870031+0000","last_clean":"2026-02-13T01:25:39.870031+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:39.870031+0000","last_undegraded":"2026-02-13T01:25:39.870031+0000","last_fullsized":"2026-02-13T01:25:39.870031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625989+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:37.625989+0000","last_peered":"2026-02-13T01:25:37.625989+0000","last_clean":"2026-02-13T01:25:37.625989+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:37.625989+0000","last_undegraded":"2026-02-13T01:25:37.625989+0000","last_fullsized":"2026-02-13T01:25:37.625989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.871415+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:39.871415+0000","last_peered":"2026-02-13T01:25:39.871415+0000","last_clean":"2026-02-13T01:25:39.871415+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:39.871415+0000","last_undegraded":"2026-02-13T01:25:39.871415+0000","last_fullsized":"2026-02-13T01:25:39.871415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139790+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:37.139790+0000","last_peered":"2026-02-13T01:25:37.139790+0000","last_clean":"2026-02-13T01:25:37.139790+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:37.139790+0000","last_undegraded":"2026-02-13T01:25:37.139790+0000","last_fullsized":"2026-02-13T01:25:37.139790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:40.874843+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:40.874843+0000","last_peered":"2026-02-13T01:25:40.874843+0000","last_clean":"2026-02-13T01:25:40.874843+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:40.874843+0000","last_undegraded":"2026-02-13T01:25:40.874843+0000","last_fullsized":"2026-02-13T01:25:40.874843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565069+0000","last_change":"2026-02-13T01:25:36.138391+0000","last_active":"2026-02-13T01:25:37.565069+0000","last_peered":"2026-02-13T01:25:37.565069+0000","last_clean":"2026-02-13T01:25:37.565069+0000","last_became_active":"2026-02-13T01:25:36.138102+0000","last_became_peered":"2026-02-13T01:25:36.138102+0000","last_unstale":"2026-02-13T01:25:37.565069+0000","last_undegraded":"2026-02-13T01:25:37.565069+0000","last_fullsized":"2026-02-13T01:25:37.565069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:42:59.417179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624993+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:37.624993+0000","last_peered":"2026-02-13T01:25:37.624993+0000","last_clean":"2026-02-13T01:25:37.624993+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:37.624993+0000","last_undegraded":"2026-02-13T01:25:37.624993+0000","last_fullsized":"2026-02-13T01:25:37.624993+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626325+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:37.626325+0000","last_peered":"2026-02-13T01:25:37.626325+0000","last_clean":"2026-02-13T01:25:37.626325+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:37.626325+0000","last_undegraded":"2026-02-13T01:25:37.626325+0000","last_fullsized":"2026-02-13T01:25:37.626325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.747887+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:38.747887+0000","last_peered":"2026-02-13T01:25:38.747887+0000","last_clean":"2026-02-13T01:25:38.747887+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:38.747887+0000","last_undegraded":"2026-02-13T01:25:38.747887+0000","last_fullsized":"2026-02-13T01:25:38.747887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626189+0000","last_change":"2026-02-13T01:25:36.140994+0000","last_active":"2026-02-13T01:25:37.626189+0000","last_peered":"2026-02-13T01:25:37.626189+0000","last_clean":"2026-02-13T01:25:37.626189+0000","last_became_active":"2026-02-13T01:25:36.140854+0000","last_became_peered":"2026-02-13T01:25:36.140854+0000","last_unstale":"2026-02-13T01:25:37.626189+0000","last_undegraded":"2026-02-13T01:25:37.626189+0000","last_fullsized":"2026-02-13T01:25:37.626189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:44.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870629+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:39.870629+0000","last_peered":"2026-02-13T01:25:39.870629+0000","last_clean":"2026-02-13T01:25:39.870629+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:39.870629+0000","last_undegraded":"2026-02-13T01:25:39.870629+0000","last_fullsized":"2026-02-13T01:25:39.870629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626265+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:37.626265+0000","last_peered":"2026-02-13T01:25:37.626265+0000","last_clean":"2026-02-13T01:25:37.626265+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:37.626265+0000","last_undegraded":"2026-02-13T01:25:37.626265+0000","last_fullsized":"2026-02-13T01:25:37.626265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626049+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:37.626049+0000","last_peered":"2026-02-13T01:25:37.626049+0000","last_clean":"2026-02-13T01:25:37.626049+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:37.626049+0000","last_undegraded":"2026-02-13T01:25:37.626049+0000","last_fullsized":"2026-02-13T01:25:37.626049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865955+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:38.865955+0000","last_peered":"2026-02-13T01:25:38.865955+0000","last_clean":"2026-02-13T01:25:38.865955+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:38.865955+0000","last_undegraded":"2026-02-13T01:25:38.865955+0000","last_fullsized":"2026-02-13T01:25:38.865955+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.137726+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:37.137726+0000","last_peered":"2026-02-13T01:25:37.137726+0000","last_clean":"2026-02-13T01:25:37.137726+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:37.137726+0000","last_undegraded":"2026-02-13T01:25:37.137726+0000","last_fullsized":"2026-02-13T01:25:37.137726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.870335+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:39.870335+0000","last_peered":"2026-02-13T01:25:39.870335+0000","last_clean":"2026-02-13T01:25:39.870335+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:39.870335+0000","last_undegraded":"2026-02-13T01:25:39.870335+0000","last_fullsized":"2026-02-13T01:25:39.870335+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624724+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:37.624724+0000","last_peered":"2026-02-13T01:25:37.624724+0000","last_clean":"2026-02-13T01:25:37.624724+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:37.624724+0000","last_undegraded":"2026-02-13T01:25:37.624724+0000","last_fullsized":"2026-02-13T01:25:37.624724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:41.877386+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:41.877386+0000","last_peered":"2026-02-13T01:25:41.877386+0000","last_clean":"2026-02-13T01:25:41.877386+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:41.877386+0000","last_undegraded":"2026-02-13T01:25:41.877386+0000","last_fullsized":"2026-02-13T01:25:41.877386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139859+0000","last_change":"2026-02-13T01:25:36.139130+0000","last_active":"2026-02-13T01:25:37.139859+0000","last_peered":"2026-02-13T01:25:37.139859+0000","last_clean":"2026-02-13T01:25:37.139859+0000","last_became_active":"2026-02-13T01:25:36.138947+0000","last_became_peered":"2026-02-13T01:25:36.138947+0000","last_unstale":"2026-02-13T01:25:37.139859+0000","last_undegraded":"2026-02-13T01:25:37.139859+0000","last_fullsized":"2026-02-13T01:25:37.139859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:30:19.260251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626111+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:37.626111+0000","last_peered":"2026-02-13T01:25:37.626111+0000","last_clean":"2026-02-13T01:25:37.626111+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:37.626111+0000","last_undegraded":"2026-02-13T01:25:37.626111+0000","last_fullsized":"2026-02-13T01:25:37.626111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139341+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:37.139341+0000","last_peered":"2026-02-13T01:25:37.139341+0000","last_clean":"2026-02-13T01:25:37.139341+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:37.139341+0000","last_undegraded":"2026-02-13T01:25:37.139341+0000","last_fullsized":"2026-02-13T01:25:37.139341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.624829+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:37.624829+0000","last_peered":"2026-02-13T01:25:37.624829+0000","last_clean":"2026-02-13T01:25:37.624829+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:37.624829+0000","last_undegraded":"2026-02-13T01:25:37.624829+0000","last_fullsized":"2026-02-13T01:25:37.624829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.807485+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:37.807485+0000","last_peered":"2026-02-13T01:25:37.807485+0000","last_clean":"2026-02-13T01:25:37.807485+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:37.807485+0000","last_undegraded":"2026-02-13T01:25:37.807485+0000","last_fullsized":"2026-02-13T01:25:37.807485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865905+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:38.865905+0000","last_peered":"2026-02-13T01:25:38.865905+0000","last_clean":"2026-02-13T01:25:38.865905+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:38.865905+0000","last_undegraded":"2026-02-13T01:25:38.865905+0000","last_fullsized":"2026-02-13T01:25:38.865905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625087+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:37.625087+0000","last_peered":"2026-02-13T01:25:37.625087+0000","last_clean":"2026-02-13T01:25:37.625087+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:37.625087+0000","last_undegraded":"2026-02-13T01:25:37.625087+0000","last_fullsized":"2026-02-13T01:25:37.625087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625108+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:37.625108+0000","last_peered":"2026-02-13T01:25:37.625108+0000","last_clean":"2026-02-13T01:25:37.625108+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:37.625108+0000","last_undegraded":"2026-02-13T01:25:37.625108+0000","last_fullsized":"2026-02-13T01:25:37.625108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138224+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:37.138224+0000","last_peered":"2026-02-13T01:25:37.138224+0000","last_clean":"2026-02-13T01:25:37.138224+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:37.138224+0000","last_undegraded":"2026-02-13T01:25:37.138224+0000","last_fullsized":"2026-02-13T01:25:37.138224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865213+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:38.865213+0000","last_peered":"2026-02-13T01:25:38.865213+0000","last_clean":"2026-02-13T01:25:38.865213+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:38.865213+0000","last_undegraded":"2026-02-13T01:25:38.865213+0000","last_fullsized":"2026-02-13T01:25:38.865213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138050+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:37.138050+0000","last_peered":"2026-02-13T01:25:37.138050+0000","last_clean":"2026-02-13T01:25:37.138050+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:37.138050+0000","last_undegraded":"2026-02-13T01:25:37.138050+0000","last_fullsized":"2026-02-13T01:25:37.138050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.864744+0000","last_change":"2026-02-13T01:25:35.141373+0000","last_active":"2026-02-13T01:25:38.864744+0000","last_peered":"2026-02-13T01:25:38.864744+0000","last_clean":"2026-02-13T01:25:38.864744+0000","last_became_active":"2026-02-13T01:25:35.141256+0000","last_became_peered":"2026-02-13T01:25:35.141256+0000","last_unstale":"2026-02-13T01:25:38.864744+0000","last_undegraded":"2026-02-13T01:25:38.864744+0000","last_fullsized":"2026-02-13T01:25:38.864744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:51:59.454888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422820+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:37.422820+0000","last_peered":"2026-02-13T01:25:37.422820+0000","last_clean":"2026-02-13T01:25:37.422820+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:37.422820+0000","last_undegraded":"2026-02-13T01:25:37.422820+0000","last_fullsized":"2026-02-13T01:25:37.422820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.864934+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:38.864934+0000","last_peered":"2026-02-13T01:25:38.864934+0000","last_clean":"2026-02-13T01:25:38.864934+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:38.864934+0000","last_undegraded":"2026-02-13T01:25:38.864934+0000","last_fullsized":"2026-02-13T01:25:38.864934+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.565021+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:37.565021+0000","last_peered":"2026-02-13T01:25:37.565021+0000","last_clean":"2026-02-13T01:25:37.565021+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:37.565021+0000","last_undegraded":"2026-02-13T01:25:37.565021+0000","last_fullsized":"2026-02-13T01:25:37.565021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626887+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:37.626887+0000","last_peered":"2026-02-13T01:25:37.626887+0000","last_clean":"2026-02-13T01:25:37.626887+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:37.626887+0000","last_undegraded":"2026-02-13T01:25:37.626887+0000","last_fullsized":"2026-02-13T01:25:37.626887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138003+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:37.138003+0000","last_peered":"2026-02-13T01:25:37.138003+0000","last_clean":"2026-02-13T01:25:37.138003+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:37.138003+0000","last_undegraded":"2026-02-13T01:25:37.138003+0000","last_fullsized":"2026-02-13T01:25:37.138003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.865803+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:38.865803+0000","last_peered":"2026-02-13T01:25:38.865803+0000","last_clean":"2026-02-13T01:25:38.865803+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:38.865803+0000","last_undegraded":"2026-02-13T01:25:38.865803+0000","last_fullsized":"2026-02-13T01:25:38.865803+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.626216+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:37.626216+0000","last_peered":"2026-02-13T01:25:37.626216+0000","last_clean":"2026-02-13T01:25:37.626216+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:37.626216+0000","last_undegraded":"2026-02-13T01:25:37.626216+0000","last_fullsized":"2026-02-13T01:25:37.626216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139916+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:37.139916+0000","last_peered":"2026-02-13T01:25:37.139916+0000","last_clean":"2026-02-13T01:25:37.139916+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:37.139916+0000","last_undegraded":"2026-02-13T01:25:37.139916+0000","last_fullsized":"2026-02-13T01:25:37.139916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.422975+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:37.422975+0000","last_peered":"2026-02-13T01:25:37.422975+0000","last_clean":"2026-02-13T01:25:37.422975+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:37.422975+0000","last_undegraded":"2026-02-13T01:25:37.422975+0000","last_fullsized":"2026-02-13T01:25:37.422975+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.139473+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:37.139473+0000","last_peered":"2026-02-13T01:25:37.139473+0000","last_clean":"2026-02-13T01:25:37.139473+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:37.139473+0000","last_undegraded":"2026-02-13T01:25:37.139473+0000","last_fullsized":"2026-02-13T01:25:37.139473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:39.869934+0000","last_change":"2026-02-13T01:25:35.134307+0000","last_active":"2026-02-13T01:25:39.869934+0000","last_peered":"2026-02-13T01:25:39.869934+0000","last_clean":"2026-02-13T01:25:39.869934+0000","last_became_active":"2026-02-13T01:25:35.134066+0000","last_became_peered":"2026-02-13T01:25:35.134066+0000","last_unstale":"2026-02-13T01:25:39.869934+0000","last_undegraded":"2026-02-13T01:25:39.869934+0000","last_fullsized":"2026-02-13T01:25:39.869934+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:37:51.552569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138180+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:37.138180+0000","last_peered":"2026-02-13T01:25:37.138180+0000","last_clean":"2026-02-13T01:25:37.138180+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:37.138180+0000","last_undegraded":"2026-02-13T01:25:37.138180+0000","last_fullsized":"2026-02-13T01:25:37.138180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:38.112048+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:38.112048+0000","last_peered":"2026-02-13T01:25:38.112048+0000","last_clean":"2026-02-13T01:25:38.112048+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:38.112048+0000","last_undegraded":"2026-02-13T01:25:38.112048+0000","last_fullsized":"2026-02-13T01:25:38.112048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.138050+0000","last_change":"2026-02-13T01:25:36.146673+0000","last_active":"2026-02-13T01:25:37.138050+0000","last_peered":"2026-02-13T01:25:37.138050+0000","last_clean":"2026-02-13T01:25:37.138050+0000","last_became_active":"2026-02-13T01:25:36.146557+0000","last_became_peered":"2026-02-13T01:25:36.146557+0000","last_unstale":"2026-02-13T01:25:37.138050+0000","last_undegraded":"2026-02-13T01:25:37.138050+0000","last_fullsized":"2026-02-13T01:25:37.138050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:02.339039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:37.625096+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:37.625096+0000","last_peered":"2026-02-13T01:25:37.625096+0000","last_clean":"2026-02-13T01:25:37.625096+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:37.625096+0000","last_undegraded":"2026-02-13T01:25:37.625096+0000","last_fullsized":"2026-02-13T01:25:37.625096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":29680,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":27,"num_read_kb":28,"num_write":125,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":47427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153761,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710726,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":380774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6234,"internal_metadata":27584422},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27840,"kb_used_data":876,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975360,"statfs":{"total":751619276800,"available":751590768640,"internally_reserved":0,"allocated":897024,"data_stored":981127,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":381580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22449,"internal_metadata":27568207},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299405,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31260,"internal_metadata":27559396},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528333,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":972956,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19473,"internal_metadata":27571183},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27752,"kb_used_data":788,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975448,"statfs":{"total":751619276800,"available":751590858752,"internally_reserved":0,"allocated":806912,"data_stored":380981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27075,"internal_metadata":27563581},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920786,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":973167,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32722,"internal_metadata":27557934},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051602,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27748,"kb_used_data":784,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975452,"statfs":{"total":751619276800,"available":751590862848,"internally_reserved":0,"allocated":802816,"data_stored":380796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40270,"internal_metadata":27550386},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280532,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47286,"internal_metadata":27543370},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":57,"kb_used_meta":26886,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":383780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58910,"internal_metadata":27531746},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640280,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":382408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44971,"internal_metadata":27545685},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771097,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":382296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46012,"internal_metadata":27544644},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2298,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":10167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33338,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28990,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10937,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4078,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2784,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8204,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27161,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8313,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23561,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:46.625 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T01:25:46.626 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T01:25:46.626 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T01:25:46.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:46 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3107527587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:46.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:46 trial187 ceph-mon[27464]: from='client.24724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:46.809 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/3715934979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb25410ecf0 msgr2=0x7fb25410f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/3715934979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb25410ecf0 0x7fb25410f0e0 secure :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=1595515775770471439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb244009970 tx=0x7fb24402ed10 comp rx=0 tx=0).stop 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/3715934979 shutdown_connections 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/3715934979 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb25410fe70 0x7fb2541102e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/3715934979 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb254110820 0x7fb2541711b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/3715934979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb25410ecf0 0x7fb25410f0e0 unknown :-1 s=CLOSED pgs=195 gs=1 cs=0 l=1 c_cookie=1595515775770471439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/3715934979 >> 10.20.193.28:0/3715934979 conn(0x7fb2540ec410 msgr2=0x7fb25410c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/3715934979 shutdown_connections 2026-02-13T01:25:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.019+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/3715934979 wait complete. 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 Processor -- start 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 -- start start 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 0x7fb25411a8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb25410fe70 0x7fb25411af20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 0x7fb25411bb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb25411c2a0 con 0x7fb254110820 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb25411c410 con 0x7fb25410ecf0 2026-02-13T01:25:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25acbb6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb25411c5d0 con 0x7fb25410fe70 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25a4ba6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 0x7fb25411bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb259cb96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 0x7fb25411a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb259cb96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 0x7fb25411a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52232/0 (socket says 10.20.193.28:52232) 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb25a4ba6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 0x7fb25411bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56504/0 (socket says 10.20.193.28:56504) 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb259cb96c0 1 -- 10.20.193.28:0/87333312 learned_addr learned my addr 10.20.193.28:0/87333312 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.020+0000 7fb2594b86c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb25410fe70 0x7fb25411af20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb259cb96c0 1 -- 10.20.193.28:0/87333312 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb25410fe70 msgr2=0x7fb25411af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb259cb96c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb25410fe70 0x7fb25411af20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb259cb96c0 1 -- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 msgr2=0x7fb25411bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb259cb96c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 0x7fb25411bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb259cb96c0 1 -- 10.20.193.28:0/87333312 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb244009590 con 0x7fb25410ecf0 2026-02-13T01:25:47.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb25a4ba6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 0x7fb25411bb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb259cb96c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 0x7fb25411a8d0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb244031fd0 tx=0x7fb244004570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb244002ae0 con 0x7fb25410ecf0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25411c850 con 0x7fb25410ecf0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb244007740 con 0x7fb25410ecf0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb244031480 con 0x7fb25410ecf0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.021+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25415cda0 con 0x7fb25410ecf0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.022+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2540643e0 con 0x7fb25410ecf0 2026-02-13T01:25:47.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.024+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fb244002c40 con 0x7fb25410ecf0 2026-02-13T01:25:47.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.026+0000 7fb242ffd6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb2300b5710 0x7fb2300d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.026+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7fb244107b90 con 0x7fb25410ecf0 2026-02-13T01:25:47.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.026+0000 7fb2594b86c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb2300b5710 0x7fb2300d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.026+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb244140600 con 0x7fb25410ecf0 2026-02-13T01:25:47.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.027+0000 7fb2594b86c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb2300b5710 0x7fb2300d5bc0 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb248004750 tx=0x7fb248009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:47.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.163+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fb25410f0c0 con 0x7fb25410ecf0 2026-02-13T01:25:47.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.165+0000 7fb242ffd6c0 1 -- 10.20.193.28:0/87333312 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fb2440ca5b0 con 0x7fb25410ecf0 2026-02-13T01:25:47.166 INFO:teuthology.orchestra.run.trial028.stdout:[client.0] 2026-02-13T01:25:47.166 INFO:teuthology.orchestra.run.trial028.stdout: key = AQCbfY5pUeTQCRAAw0+aQOPIfMTRt8Q5gY/uhA== 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb2300b5710 msgr2=0x7fb2300d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb2300b5710 0x7fb2300d5bc0 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb248004750 tx=0x7fb248009260 comp rx=0 tx=0).stop 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 msgr2=0x7fb25411a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 0x7fb25411a8d0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb244031fd0 tx=0x7fb244004570 comp rx=0 tx=0).stop 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 shutdown_connections 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb2300b5710 0x7fb2300d5bc0 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb25410fe70 0x7fb25411af20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb254110820 0x7fb25411bb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 --2- 10.20.193.28:0/87333312 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb25410ecf0 0x7fb25411a8d0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 >> 10.20.193.28:0/87333312 conn(0x7fb2540ec410 msgr2=0x7fb25410c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 shutdown_connections 2026-02-13T01:25:47.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.167+0000 7fb25acbb6c0 1 -- 10.20.193.28:0/87333312 wait complete. 2026-02-13T01:25:47.272 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-13T01:25:47.272 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T01:25:47.272 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T01:25:47.349 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T01:25:47.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:47 trial028 ceph-mon[22984]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:47.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:47 trial028 ceph-mon[22984]: pgmap v201: 97 pgs: 97 active+clean; 606 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 7.3 KiB/s wr, 17 op/s 2026-02-13T01:25:47.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:47 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:47.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:47 trial028 ceph-mon[22984]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:25:47.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:47 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/87333312' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:47.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:47 trial134 ceph-mon[27948]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:47.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:47 trial134 ceph-mon[27948]: pgmap v201: 97 pgs: 97 active+clean; 606 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 7.3 KiB/s wr, 17 op/s 2026-02-13T01:25:47.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:47 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:47.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:47 trial134 ceph-mon[27948]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:25:47.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:47 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/87333312' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:47.571 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:47.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:47 trial187 ceph-mon[27464]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:47.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:47 trial187 ceph-mon[27464]: pgmap v201: 97 pgs: 97 active+clean; 606 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 7.3 KiB/s wr, 17 op/s 2026-02-13T01:25:47.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:47 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:47.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:47 trial187 ceph-mon[27464]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:25:47.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:47 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/87333312' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/3623531952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a810f060 msgr2=0x7ff9a810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/3623531952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a810f060 0x7ff9a810f430 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=11684258341369667472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9940099a0 tx=0x7ff99402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/3623531952 shutdown_connections 2026-02-13T01:25:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/3623531952 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff9a810fa50 0x7ff9a8114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/3623531952 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a8115270 0x7ff9a8175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/3623531952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a810f060 0x7ff9a810f430 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=11684258341369667472 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/3623531952 >> 10.20.193.28:0/3623531952 conn(0x7ff9a80ec980 msgr2=0x7ff9a810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/3623531952 shutdown_connections 2026-02-13T01:25:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.770+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/3623531952 wait complete. 2026-02-13T01:25:47.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 Processor -- start 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 -- start start 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a810f060 0x7ff9a811cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 0x7ff9a811d500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff9a81228c0 0x7ff9a8122d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81232d0 con 0x7ff9a8115270 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8123440 con 0x7ff9a810f060 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ad1026c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8123600 con 0x7ff9a81228c0 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 0x7ff9a811d500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 0x7ff9a811d500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56530/0 (socket says 10.20.193.28:56530) 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 -- 10.20.193.28:0/748522859 learned_addr learned my addr 10.20.193.28:0/748522859 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9ac9016c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff9a81228c0 0x7ff9a8122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a7fff6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a810f060 0x7ff9a811cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 -- 10.20.193.28:0/748522859 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff9a81228c0 msgr2=0x7ff9a8122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff9a81228c0 0x7ff9a8122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 -- 10.20.193.28:0/748522859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a810f060 msgr2=0x7ff9a811cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a810f060 0x7ff9a811cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a77fe6c0 1 -- 10.20.193.28:0/748522859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff994009590 con 0x7ff9a8115270 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.771+0000 7ff9a7fff6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a810f060 0x7ff9a811cfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9a77fe6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 0x7ff9a811d500 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff99800b750 tx=0x7ff99800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff998004a80 con 0x7ff9a8115270 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a8163ab0 con 0x7ff9a8115270 2026-02-13T01:25:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff998009030 con 0x7ff9a8115270 2026-02-13T01:25:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff998005630 con 0x7ff9a8115270 2026-02-13T01:25:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a8163f40 con 0x7ff9a8115270 2026-02-13T01:25:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.772+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a8110330 con 0x7ff9a8115270 2026-02-13T01:25:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.775+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff9980026b0 con 0x7ff9a8115270 2026-02-13T01:25:47.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.777+0000 7ff9a57fa6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff97c0b5710 0x7ff97c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:47.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.777+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7ff9980e3a90 con 0x7ff9a8115270 2026-02-13T01:25:47.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.777+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff99811c5e0 con 0x7ff9a8115270 2026-02-13T01:25:47.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.777+0000 7ff9a7fff6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff97c0b5710 0x7ff97c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:47.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.777+0000 7ff9a7fff6c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff97c0b5710 0x7ff97c0d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9940023e0 tx=0x7ff99402f5c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:47.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.878+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7ff9a811e170 con 0x7ff9a8115270 2026-02-13T01:25:47.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.878+0000 7ff9a57fa6c0 1 -- 10.20.193.28:0/748522859 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v45) ==== 86+0+133 (secure 0 0 0) 0x7ff9980a64b0 con 0x7ff9a8115270 2026-02-13T01:25:47.879 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:47.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff97c0b5710 msgr2=0x7ff97c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff97c0b5710 0x7ff97c0d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9940023e0 tx=0x7ff99402f5c0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 msgr2=0x7ff9a811d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 0x7ff9a811d500 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff99800b750 tx=0x7ff99800bc20 comp rx=0 tx=0).stop 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 shutdown_connections 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff97c0b5710 0x7ff97c0d5bc0 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff9a81228c0 0x7ff9a8122d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9a8115270 0x7ff9a811d500 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 --2- 10.20.193.28:0/748522859 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff9a810f060 0x7ff9a811cfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 >> 10.20.193.28:0/748522859 conn(0x7ff9a80ec980 msgr2=0x7ff9a810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 shutdown_connections 2026-02-13T01:25:47.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:47.879+0000 7ff9ad1026c0 1 -- 10.20.193.28:0/748522859 wait complete. 2026-02-13T01:25:47.985 INFO:teuthology.orchestra.run.trial028.stdout:[{"version":45,"timestamp":"2026-02-13T01:25:30.742678+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T01:25:47.986 INFO:tasks.ceph_manager:config epoch is 45 2026-02-13T01:25:47.986 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T01:25:47.986 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T01:25:47.986 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T01:25:48.171 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:48.215 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:48 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/748522859' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:25:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.362+0000 7fada2b736c0 1 -- 10.20.193.28:0/234967789 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10fa50 msgr2=0x7fad9c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.362+0000 7fada2b736c0 1 --2- 10.20.193.28:0/234967789 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10fa50 0x7fad9c114a90 secure :-1 s=READY pgs=77 gs=2 cs=0 l=1 c_cookie=4161233496030092696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad90009970 tx=0x7fad9002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 -- 10.20.193.28:0/234967789 shutdown_connections 2026-02-13T01:25:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 --2- 10.20.193.28:0/234967789 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fad9c115270 0x7fad9c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 --2- 10.20.193.28:0/234967789 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10fa50 0x7fad9c114a90 unknown :-1 s=CLOSED pgs=77 gs=2 cs=0 l=1 c_cookie=4161233496030092696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 --2- 10.20.193.28:0/234967789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9c10f060 0x7fad9c10f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 -- 10.20.193.28:0/234967789 >> 10.20.193.28:0/234967789 conn(0x7fad9c0ec980 msgr2=0x7fad9c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 -- 10.20.193.28:0/234967789 shutdown_connections 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 -- 10.20.193.28:0/234967789 wait complete. 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 Processor -- start 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.363+0000 7fada2b736c0 1 -- start start 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada2b736c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 0x7fad9c0f4910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada2b736c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9c115270 0x7fad9c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada2b736c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fad9c0f4f40 0x7fad9c0fa210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada2b736c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0f5630 con 0x7fad9c115270 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada2b736c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0fa750 con 0x7fad9c10f060 2026-02-13T01:25:48.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada2b736c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0fa910 con 0x7fad9c0f4f40 2026-02-13T01:25:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 0x7fad9c0f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 0x7fad9c0f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52266/0 (socket says 10.20.193.28:52266) 2026-02-13T01:25:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 -- 10.20.193.28:0/2340607704 learned_addr learned my addr 10.20.193.28:0/2340607704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada13706c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9c115270 0x7fad9c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada23726c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fad9c0f4f40 0x7fad9c0fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 -- 10.20.193.28:0/2340607704 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fad9c0f4f40 msgr2=0x7fad9c0fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fad9c0f4f40 0x7fad9c0fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 -- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9c115270 msgr2=0x7fad9c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9c115270 0x7fad9c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.364+0000 7fada1b716c0 1 -- 10.20.193.28:0/2340607704 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c0094c0 con 0x7fad9c10f060 2026-02-13T01:25:48.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fada1b716c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 0x7fad9c0f4910 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad8c00ba60 tx=0x7fad8c00bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad8c0044a0 con 0x7fad9c10f060 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90009590 con 0x7fad9c10f060 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fad8c009030 con 0x7fad9c10f060 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fad8c0071c0 con 0x7fad9c10f060 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c0faf90 con 0x7fad9c10f060 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.365+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c110330 con 0x7fad9c10f060 2026-02-13T01:25:48.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.367+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fad8c0026b0 con 0x7fad9c10f060 2026-02-13T01:25:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.369+0000 7fad8affd6c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad780b5710 0x7fad780d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.369+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7fad8c0e3aa0 con 0x7fad9c10f060 2026-02-13T01:25:48.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.369+0000 7fada13706c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad780b5710 0x7fad780d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.369+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fad8c11c5e0 con 0x7fad9c10f060 2026-02-13T01:25:48.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.370+0000 7fada13706c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad780b5710 0x7fad780d5bc0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad9c0fb2a0 tx=0x7fad900023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:48.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.497+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fad9c10f430 con 0x7fad9c10f060 2026-02-13T01:25:48.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.500+0000 7fad8affd6c0 1 -- 10.20.193.28:0/2340607704 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v11) ==== 74+0+297575 (secure 0 0 0) 0x7fad8c0a64c0 con 0x7fad9c10f060 2026-02-13T01:25:48.504 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:48.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.502+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad780b5710 msgr2=0x7fad780d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.502+0000 7fada2b736c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad780b5710 0x7fad780d5bc0 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad9c0fb2a0 tx=0x7fad900023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.502+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 msgr2=0x7fad9c0f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.502+0000 7fada2b736c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 0x7fad9c0f4910 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fad8c00ba60 tx=0x7fad8c00bf30 comp rx=0 tx=0).stop 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 shutdown_connections 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad780b5710 0x7fad780d5bc0 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fad9c0f4f40 0x7fad9c0fa210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad9c115270 0x7fad9c175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 --2- 10.20.193.28:0/2340607704 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fad9c10f060 0x7fad9c0f4910 unknown :-1 s=CLOSED pgs=78 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 >> 10.20.193.28:0/2340607704 conn(0x7fad9c0ec980 msgr2=0x7fad9c10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 shutdown_connections 2026-02-13T01:25:48.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.503+0000 7fada2b736c0 1 -- 10.20.193.28:0/2340607704 wait complete. 2026-02-13T01:25:48.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:48 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/748522859' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:25:48.607 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":11,"flags":0,"active_gid":14116,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":378944679},{"type":"v1","addr":"10.20.193.28:6801","nonce":378944679}]},"active_addr":"10.20.193.28:6801/378944679","active_change":"2026-02-13T01:22:50.012011+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14235,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24146,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":2,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":2160499187}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3246503033}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":1808550293}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":653525664}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":4109662425}]}]} 2026-02-13T01:25:48.618 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T01:25:48.618 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T01:25:48.618 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:48.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:48 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/748522859' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:25:48.802 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/292143179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b81149c0 msgr2=0x7ff6b8114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/292143179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b81149c0 0x7ff6b8114ee0 secure :-1 s=READY pgs=198 gs=3 cs=0 l=1 c_cookie=1497576657502408850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6a8006fd0 tx=0x7ff6a802fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/292143179 shutdown_connections 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/292143179 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6b8113dc0 0x7ff6b8114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/292143179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b81149c0 0x7ff6b8114ee0 unknown :-1 s=CLOSED pgs=198 gs=3 cs=0 l=1 c_cookie=1497576657502408850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/292143179 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b811b510 0x7ff6b811b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/292143179 >> 10.20.193.28:0/292143179 conn(0x7ff6b8058a50 msgr2=0x7ff6b8058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.988+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/292143179 shutdown_connections 2026-02-13T01:25:48.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.989+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/292143179 wait complete. 2026-02-13T01:25:48.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.989+0000 7ff6bd1b76c0 1 Processor -- start 2026-02-13T01:25:48.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.989+0000 7ff6bd1b76c0 1 -- start start 2026-02-13T01:25:48.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 0x7ff6b812b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b81149c0 0x7ff6b812bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6b811b510 0x7ff6b81310d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8131720 con 0x7ff6b8113dc0 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8131890 con 0x7ff6b81149c0 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8131a50 con 0x7ff6b811b510 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 0x7ff6b812b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 0x7ff6b812b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56570/0 (socket says 10.20.193.28:56570) 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 -- 10.20.193.28:0/252006464 learned_addr learned my addr 10.20.193.28:0/252006464 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b65756c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b81149c0 0x7ff6b812bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b75776c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6b811b510 0x7ff6b81310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 -- 10.20.193.28:0/252006464 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6b811b510 msgr2=0x7ff6b81310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6b811b510 0x7ff6b81310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 -- 10.20.193.28:0/252006464 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b81149c0 msgr2=0x7ff6b812bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b81149c0 0x7ff6b812bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 -- 10.20.193.28:0/252006464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac009590 con 0x7ff6b8113dc0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b65756c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b81149c0 0x7ff6b812bd10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6b6d766c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 0x7ff6b812b7d0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac004750 tx=0x7ff6ac00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6ac0044a0 con 0x7ff6b8113dc0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6ac009030 con 0x7ff6b8113dc0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6ac0071c0 con 0x7ff6b8113dc0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.990+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a800a5b0 con 0x7ff6b8113dc0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.991+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b8172260 con 0x7ff6b8113dc0 2026-02-13T01:25:48.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.991+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b805b000 con 0x7ff6b8113dc0 2026-02-13T01:25:48.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.993+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff6ac0026b0 con 0x7ff6b8113dc0 2026-02-13T01:25:48.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.995+0000 7ff697fff6c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff68c0b5860 0x7ff68c0d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.995+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7ff6ac0e3b20 con 0x7ff6b8113dc0 2026-02-13T01:25:48.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.995+0000 7ff6b65756c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff68c0b5860 0x7ff68c0d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.995+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff6ac11c5e0 con 0x7ff6b8113dc0 2026-02-13T01:25:48.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:48.995+0000 7ff6b65756c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff68c0b5860 0x7ff68c0d5d10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b8132160 tx=0x7ff6a0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:49.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.096+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6b8114ee0 con 0x7ff6b8113dc0 2026-02-13T01:25:49.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.097+0000 7ff697fff6c0 1 -- 10.20.193.28:0/252006464 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22038 (secure 0 0 0) 0x7ff6ac0a65d0 con 0x7ff6b8113dc0 2026-02-13T01:25:49.098 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:49.098 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":75,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","created":"2026-02-13T01:22:41.806447+0000","modified":"2026-02-13T01:25:37.132531+0000","last_up_change":"2026-02-13T01:25:14.875697+0000","last_in_change":"2026-02-13T01:25:06.785151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:58.205191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:33.235628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:34.724553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b609cc73-d28a-4ba8-9724-13ee6cc98de8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6803","nonce":2961143377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6805","nonce":2961143377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6809","nonce":2961143377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6807","nonce":2961143377}]},"public_addr":"10.20.193.28:6803/2961143377","cluster_addr":"10.20.193.28:6805/2961143377","heartbeat_back_addr":"10.20.193.28:6809/2961143377","heartbeat_front_addr":"10.20.193.28:6807/2961143377","state":["exists","up"]},{"osd":1,"uuid":"8b21607c-6340-49b2-ae85-eb92729919c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6800","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6801","nonce":2922978638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6802","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6803","nonce":2922978638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6806","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6807","nonce":2922978638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6804","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6805","nonce":2922978638}]},"public_addr":"10.20.193.134:6801/2922978638","cluster_addr":"10.20.193.134:6803/2922978638","heartbeat_back_addr":"10.20.193.134:6807/2922978638","heartbeat_front_addr":"10.20.193.134:6805/2922978638","state":["exists","up"]},{"osd":2,"uuid":"6f3ebd5b-92a4-4b56-b83b-1ef57483f823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6800","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6801","nonce":28326527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6802","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6803","nonce":28326527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6806","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6807","nonce":28326527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6804","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6805","nonce":28326527}]},"public_addr":"10.20.193.187:6801/28326527","cluster_addr":"10.20.193.187:6803/28326527","heartbeat_back_addr":"10.20.193.187:6807/28326527","heartbeat_front_addr":"10.20.193.187:6805/28326527","state":["exists","up"]},{"osd":3,"uuid":"f8c87696-e524-441f-b262-8f1b1b088b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6811","nonce":3039326126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6813","nonce":3039326126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6817","nonce":3039326126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6815","nonce":3039326126}]},"public_addr":"10.20.193.28:6811/3039326126","cluster_addr":"10.20.193.28:6813/3039326126","heartbeat_back_addr":"10.20.193.28:6817/3039326126","heartbeat_front_addr":"10.20.193.28:6815/3039326126","state":["exists","up"]},{"osd":4,"uuid":"181c4948-a9b0-4bf5-bb9a-5071865e44ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6808","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6809","nonce":2852482005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6810","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6811","nonce":2852482005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6814","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6815","nonce":2852482005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6812","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6813","nonce":2852482005}]},"public_addr":"10.20.193.134:6809/2852482005","cluster_addr":"10.20.193.134:6811/2852482005","heartbeat_back_addr":"10.20.193.134:6815/2852482005","heartbeat_front_addr":"10.20.193.134:6813/2852482005","state":["exists","up"]},{"osd":5,"uuid":"05fa2cf3-9b55-4589-9db7-f7f20c478be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6808","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6809","nonce":3424321792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6810","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6811","nonce":3424321792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6814","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6815","nonce":3424321792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6812","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6813","nonce":3424321792}]},"public_addr":"10.20.193.187:6809/3424321792","cluster_addr":"10.20.193.187:6811/3424321792","heartbeat_back_addr":"10.20.193.187:6815/3424321792","heartbeat_front_addr":"10.20.193.187:6813/3424321792","state":["exists","up"]},{"osd":6,"uuid":"7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6819","nonce":2743891845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6821","nonce":2743891845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6825","nonce":2743891845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6823","nonce":2743891845}]},"public_addr":"10.20.193.28:6819/2743891845","cluster_addr":"10.20.193.28:6821/2743891845","heartbeat_back_addr":"10.20.193.28:6825/2743891845","heartbeat_front_addr":"10.20.193.28:6823/2743891845","state":["exists","up"]},{"osd":7,"uuid":"83f5f6ed-fa57-4628-bcf0-49d51edea60d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6816","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6817","nonce":55376257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6818","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6819","nonce":55376257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6822","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6823","nonce":55376257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6820","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6821","nonce":55376257}]},"public_addr":"10.20.193.134:6817/55376257","cluster_addr":"10.20.193.134:6819/55376257","heartbeat_back_addr":"10.20.193.134:6823/55376257","heartbeat_front_addr":"10.20.193.134:6821/55376257","state":["exists","up"]},{"osd":8,"uuid":"63963560-6c24-4627-aade-6d99ec304b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6816","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6817","nonce":2802029994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6818","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6819","nonce":2802029994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6822","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6823","nonce":2802029994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6820","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6821","nonce":2802029994}]},"public_addr":"10.20.193.187:6817/2802029994","cluster_addr":"10.20.193.187:6819/2802029994","heartbeat_back_addr":"10.20.193.187:6823/2802029994","heartbeat_front_addr":"10.20.193.187:6821/2802029994","state":["exists","up"]},{"osd":9,"uuid":"184bf253-88c2-45c2-a17b-e1d06b4b1985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6827","nonce":1895700373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6829","nonce":1895700373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6833","nonce":1895700373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6831","nonce":1895700373}]},"public_addr":"10.20.193.28:6827/1895700373","cluster_addr":"10.20.193.28:6829/1895700373","heartbeat_back_addr":"10.20.193.28:6833/1895700373","heartbeat_front_addr":"10.20.193.28:6831/1895700373","state":["exists","up"]},{"osd":10,"uuid":"d23958fb-8b6d-4d42-9a41-d55ea62f4328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6824","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6825","nonce":1465401365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6826","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6827","nonce":1465401365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6830","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6831","nonce":1465401365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6828","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6829","nonce":1465401365}]},"public_addr":"10.20.193.134:6825/1465401365","cluster_addr":"10.20.193.134:6827/1465401365","heartbeat_back_addr":"10.20.193.134:6831/1465401365","heartbeat_front_addr":"10.20.193.134:6829/1465401365","state":["exists","up"]},{"osd":11,"uuid":"49d3cb86-161d-4c61-af51-58a293ae6948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6824","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6825","nonce":3880817278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6826","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6827","nonce":3880817278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6830","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6831","nonce":3880817278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6828","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6829","nonce":3880817278}]},"public_addr":"10.20.193.187:6825/3880817278","cluster_addr":"10.20.193.187:6827/3880817278","heartbeat_back_addr":"10.20.193.187:6831/3880817278","heartbeat_front_addr":"10.20.193.187:6829/3880817278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.844101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:48.399902+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.304413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:06.142985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:13.695054+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:20.759285+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.814864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:39.345155+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.698150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:58.098934+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:05.932878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:13.217409+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/2396565153":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/2466054030":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/4240498935":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6801/4264511310":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6800/4264511310":"2026-02-14T01:22:50.011933+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:49.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff68c0b5860 msgr2=0x7ff68c0d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff68c0b5860 0x7ff68c0d5d10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b8132160 tx=0x7ff6a0009260 comp rx=0 tx=0).stop 2026-02-13T01:25:49.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 msgr2=0x7ff6b812b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 0x7ff6b812b7d0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac004750 tx=0x7ff6ac00be00 comp rx=0 tx=0).stop 2026-02-13T01:25:49.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 shutdown_connections 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff68c0b5860 0x7ff68c0d5d10 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6b811b510 0x7ff6b81310d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6b81149c0 0x7ff6b812bd10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 --2- 10.20.193.28:0/252006464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6b8113dc0 0x7ff6b812b7d0 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 >> 10.20.193.28:0/252006464 conn(0x7ff6b8058a50 msgr2=0x7ff6b8119800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 shutdown_connections 2026-02-13T01:25:49.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.099+0000 7ff6bd1b76c0 1 -- 10.20.193.28:0/252006464 wait complete. 2026-02-13T01:25:49.202 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T01:25:49.202 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:49.385 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:49.427 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2340607704' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:25:49.427 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:49 trial028 ceph-mon[22984]: pgmap v202: 97 pgs: 97 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 8.6 KiB/s wr, 17 op/s 2026-02-13T01:25:49.427 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/252006464' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:49.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2340607704' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:25:49.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:49 trial134 ceph-mon[27948]: pgmap v202: 97 pgs: 97 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 8.6 KiB/s wr, 17 op/s 2026-02-13T01:25:49.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/252006464' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:49.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 -- 10.20.193.28:0/3868939073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b410f060 msgr2=0x7fd8b410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/3868939073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b410f060 0x7fd8b410f430 secure :-1 s=READY pgs=200 gs=2 cs=0 l=1 c_cookie=11279145510704181458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a80099a0 tx=0x7fd8a802ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:49.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 -- 10.20.193.28:0/3868939073 shutdown_connections 2026-02-13T01:25:49.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/3868939073 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 0x7fd8b4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/3868939073 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd8b410fa50 0x7fd8b4114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/3868939073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b410f060 0x7fd8b410f430 unknown :-1 s=CLOSED pgs=200 gs=2 cs=0 l=1 c_cookie=11279145510704181458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 -- 10.20.193.28:0/3868939073 >> 10.20.193.28:0/3868939073 conn(0x7fd8b40ec980 msgr2=0x7fd8b410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:49.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 -- 10.20.193.28:0/3868939073 shutdown_connections 2026-02-13T01:25:49.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.570+0000 7fd8b35776c0 1 -- 10.20.193.28:0/3868939073 wait complete. 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 Processor -- start 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 -- start start 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd8b410f060 0x7fd8b411cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 0x7fd8b411d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 0x7fd8b4122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b4123240 con 0x7fd8b4122830 2026-02-13T01:25:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b41233b0 con 0x7fd8b410f060 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b35776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b4123570 con 0x7fd8b4115270 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b2d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 0x7fd8b4122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b2d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 0x7fd8b4122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56588/0 (socket says 10.20.193.28:56588) 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.571+0000 7fd8b2d766c0 1 -- 10.20.193.28:0/1388778416 learned_addr learned my addr 10.20.193.28:0/1388778416 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b1d746c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 0x7fd8b411d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b25756c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd8b410f060 0x7fd8b411cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b2d766c0 1 -- 10.20.193.28:0/1388778416 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 msgr2=0x7fd8b411d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b2d766c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 0x7fd8b411d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b2d766c0 1 -- 10.20.193.28:0/1388778416 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd8b410f060 msgr2=0x7fd8b411cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b2d766c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd8b410f060 0x7fd8b411cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b2d766c0 1 -- 10.20.193.28:0/1388778416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a8009590 con 0x7fd8b4122830 2026-02-13T01:25:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b1d746c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 0x7fd8b411d470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b2d766c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 0x7fd8b4122cd0 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a4006ea0 tx=0x7fd8a400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8a4003c40 con 0x7fd8b4122830 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b4163a20 con 0x7fd8b4122830 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd8a4003da0 con 0x7fd8b4122830 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd8a40081c0 con 0x7fd8b4122830 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.572+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b4163eb0 con 0x7fd8b4122830 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.573+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b4110330 con 0x7fd8b4122830 2026-02-13T01:25:49.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.575+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fd8a4005030 con 0x7fd8b4122830 2026-02-13T01:25:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.577+0000 7fd89b7fe6c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd88c0b5710 0x7fd88c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.577+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7762+0+0 (secure 0 0 0) 0x7fd8a40e4c60 con 0x7fd8b4122830 2026-02-13T01:25:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.577+0000 7fd8b25756c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd88c0b5710 0x7fd88c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.577+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd8a40e5150 con 0x7fd8b4122830 2026-02-13T01:25:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.578+0000 7fd8b25756c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd88c0b5710 0x7fd88c0d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a80023e0 tx=0x7fd8a8005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:49.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2340607704' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:25:49.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:49 trial187 ceph-mon[27464]: pgmap v202: 97 pgs: 97 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 8.6 KiB/s wr, 17 op/s 2026-02-13T01:25:49.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/252006464' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:49.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.677+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8b411e0b0 con 0x7fd8b4122830 2026-02-13T01:25:49.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.678+0000 7fd89b7fe6c0 1 -- 10.20.193.28:0/1388778416 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22038 (secure 0 0 0) 0x7fd8a40a76c0 con 0x7fd8b4122830 2026-02-13T01:25:49.679 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:49.679 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":75,"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","created":"2026-02-13T01:22:41.806447+0000","modified":"2026-02-13T01:25:37.132531+0000","last_up_change":"2026-02-13T01:25:14.875697+0000","last_in_change":"2026-02-13T01:25:06.785151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:58.205191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:33.235628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:34.724553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b609cc73-d28a-4ba8-9724-13ee6cc98de8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6803","nonce":2961143377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6805","nonce":2961143377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6809","nonce":2961143377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":2961143377},{"type":"v1","addr":"10.20.193.28:6807","nonce":2961143377}]},"public_addr":"10.20.193.28:6803/2961143377","cluster_addr":"10.20.193.28:6805/2961143377","heartbeat_back_addr":"10.20.193.28:6809/2961143377","heartbeat_front_addr":"10.20.193.28:6807/2961143377","state":["exists","up"]},{"osd":1,"uuid":"8b21607c-6340-49b2-ae85-eb92729919c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6800","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6801","nonce":2922978638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6802","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6803","nonce":2922978638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6806","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6807","nonce":2922978638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6804","nonce":2922978638},{"type":"v1","addr":"10.20.193.134:6805","nonce":2922978638}]},"public_addr":"10.20.193.134:6801/2922978638","cluster_addr":"10.20.193.134:6803/2922978638","heartbeat_back_addr":"10.20.193.134:6807/2922978638","heartbeat_front_addr":"10.20.193.134:6805/2922978638","state":["exists","up"]},{"osd":2,"uuid":"6f3ebd5b-92a4-4b56-b83b-1ef57483f823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6800","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6801","nonce":28326527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6802","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6803","nonce":28326527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6806","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6807","nonce":28326527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6804","nonce":28326527},{"type":"v1","addr":"10.20.193.187:6805","nonce":28326527}]},"public_addr":"10.20.193.187:6801/28326527","cluster_addr":"10.20.193.187:6803/28326527","heartbeat_back_addr":"10.20.193.187:6807/28326527","heartbeat_front_addr":"10.20.193.187:6805/28326527","state":["exists","up"]},{"osd":3,"uuid":"f8c87696-e524-441f-b262-8f1b1b088b22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6811","nonce":3039326126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6813","nonce":3039326126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6817","nonce":3039326126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":3039326126},{"type":"v1","addr":"10.20.193.28:6815","nonce":3039326126}]},"public_addr":"10.20.193.28:6811/3039326126","cluster_addr":"10.20.193.28:6813/3039326126","heartbeat_back_addr":"10.20.193.28:6817/3039326126","heartbeat_front_addr":"10.20.193.28:6815/3039326126","state":["exists","up"]},{"osd":4,"uuid":"181c4948-a9b0-4bf5-bb9a-5071865e44ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6808","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6809","nonce":2852482005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6810","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6811","nonce":2852482005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6814","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6815","nonce":2852482005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6812","nonce":2852482005},{"type":"v1","addr":"10.20.193.134:6813","nonce":2852482005}]},"public_addr":"10.20.193.134:6809/2852482005","cluster_addr":"10.20.193.134:6811/2852482005","heartbeat_back_addr":"10.20.193.134:6815/2852482005","heartbeat_front_addr":"10.20.193.134:6813/2852482005","state":["exists","up"]},{"osd":5,"uuid":"05fa2cf3-9b55-4589-9db7-f7f20c478be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6808","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6809","nonce":3424321792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6810","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6811","nonce":3424321792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6814","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6815","nonce":3424321792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6812","nonce":3424321792},{"type":"v1","addr":"10.20.193.187:6813","nonce":3424321792}]},"public_addr":"10.20.193.187:6809/3424321792","cluster_addr":"10.20.193.187:6811/3424321792","heartbeat_back_addr":"10.20.193.187:6815/3424321792","heartbeat_front_addr":"10.20.193.187:6813/3424321792","state":["exists","up"]},{"osd":6,"uuid":"7c31d0f5-eeeb-4582-b3f1-0b7f4ba904bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6819","nonce":2743891845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6821","nonce":2743891845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6825","nonce":2743891845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":2743891845},{"type":"v1","addr":"10.20.193.28:6823","nonce":2743891845}]},"public_addr":"10.20.193.28:6819/2743891845","cluster_addr":"10.20.193.28:6821/2743891845","heartbeat_back_addr":"10.20.193.28:6825/2743891845","heartbeat_front_addr":"10.20.193.28:6823/2743891845","state":["exists","up"]},{"osd":7,"uuid":"83f5f6ed-fa57-4628-bcf0-49d51edea60d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6816","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6817","nonce":55376257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6818","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6819","nonce":55376257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6822","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6823","nonce":55376257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6820","nonce":55376257},{"type":"v1","addr":"10.20.193.134:6821","nonce":55376257}]},"public_addr":"10.20.193.134:6817/55376257","cluster_addr":"10.20.193.134:6819/55376257","heartbeat_back_addr":"10.20.193.134:6823/55376257","heartbeat_front_addr":"10.20.193.134:6821/55376257","state":["exists","up"]},{"osd":8,"uuid":"63963560-6c24-4627-aade-6d99ec304b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6816","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6817","nonce":2802029994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6818","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6819","nonce":2802029994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6822","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6823","nonce":2802029994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6820","nonce":2802029994},{"type":"v1","addr":"10.20.193.187:6821","nonce":2802029994}]},"public_addr":"10.20.193.187:6817/2802029994","cluster_addr":"10.20.193.187:6819/2802029994","heartbeat_back_addr":"10.20.193.187:6823/2802029994","heartbeat_front_addr":"10.20.193.187:6821/2802029994","state":["exists","up"]},{"osd":9,"uuid":"184bf253-88c2-45c2-a17b-e1d06b4b1985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6827","nonce":1895700373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6829","nonce":1895700373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6833","nonce":1895700373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":1895700373},{"type":"v1","addr":"10.20.193.28:6831","nonce":1895700373}]},"public_addr":"10.20.193.28:6827/1895700373","cluster_addr":"10.20.193.28:6829/1895700373","heartbeat_back_addr":"10.20.193.28:6833/1895700373","heartbeat_front_addr":"10.20.193.28:6831/1895700373","state":["exists","up"]},{"osd":10,"uuid":"d23958fb-8b6d-4d42-9a41-d55ea62f4328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6824","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6825","nonce":1465401365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6826","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6827","nonce":1465401365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6830","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6831","nonce":1465401365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.134:6828","nonce":1465401365},{"type":"v1","addr":"10.20.193.134:6829","nonce":1465401365}]},"public_addr":"10.20.193.134:6825/1465401365","cluster_addr":"10.20.193.134:6827/1465401365","heartbeat_back_addr":"10.20.193.134:6831/1465401365","heartbeat_front_addr":"10.20.193.134:6829/1465401365","state":["exists","up"]},{"osd":11,"uuid":"49d3cb86-161d-4c61-af51-58a293ae6948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6824","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6825","nonce":3880817278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6826","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6827","nonce":3880817278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6830","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6831","nonce":3880817278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.187:6828","nonce":3880817278},{"type":"v1","addr":"10.20.193.187:6829","nonce":3880817278}]},"public_addr":"10.20.193.187:6825/3880817278","cluster_addr":"10.20.193.187:6827/3880817278","heartbeat_back_addr":"10.20.193.187:6831/3880817278","heartbeat_front_addr":"10.20.193.187:6829/3880817278","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.844101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:48.399902+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.304413+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:06.142985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:13.695054+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:20.759285+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.814864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:39.345155+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.698150+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:58.098934+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:05.932878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:25:13.217409+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:0/2396565153":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/2466054030":"2026-02-14T01:22:50.011933+0000","10.20.193.28:0/4240498935":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6801/4264511310":"2026-02-14T01:22:50.011933+0000","10.20.193.28:6800/4264511310":"2026-02-14T01:22:50.011933+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:49.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd88c0b5710 msgr2=0x7fd88c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd88c0b5710 0x7fd88c0d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a80023e0 tx=0x7fd8a8005c80 comp rx=0 tx=0).stop 2026-02-13T01:25:49.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 msgr2=0x7fd8b4122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:49.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 0x7fd8b4122cd0 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a4006ea0 tx=0x7fd8a400ce50 comp rx=0 tx=0).stop 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 shutdown_connections 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd88c0b5710 0x7fd88c0d5bc0 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd8b4115270 0x7fd8b411d470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b4122830 0x7fd8b4122cd0 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 --2- 10.20.193.28:0/1388778416 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd8b410f060 0x7fd8b411cf30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 >> 10.20.193.28:0/1388778416 conn(0x7fd8b40ec980 msgr2=0x7fd8b410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 shutdown_connections 2026-02-13T01:25:49.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:49.679+0000 7fd8b35776c0 1 -- 10.20.193.28:0/1388778416 wait complete. 2026-02-13T01:25:49.784 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T01:25:49.784 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T01:25:49.785 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T01:25:49.785 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T01:25:49.786 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T01:25:49.786 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T01:25:49.787 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T01:25:49.787 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T01:25:49.788 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T01:25:49.788 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T01:25:49.788 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T01:25:49.789 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T01:25:50.035 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.055 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.075 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.090 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.100 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.115 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.134 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.141 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.174 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.177 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.203 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.216 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:50.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 -- 10.20.193.28:0/1485820380 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c114000 msgr2=0x7f160c1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f16095736c0 1 -- 10.20.193.28:0/1485820380 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15fc0044a0 con 0x7f160c114000 2026-02-13T01:25:50.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/1485820380 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c114000 0x7f160c1143d0 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=16329462671424623206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15fc009970 tx=0x7f15fc02ed70 comp rx=0 tx=0).stop 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 -- 10.20.193.28:0/1485820380 shutdown_connections 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/1485820380 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f160c116b30 0x7f160c17a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/1485820380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c1149f0 0x7f160c116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/1485820380 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c114000 0x7f160c1143d0 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=16329462671424623206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.352+0000 7f1610bb06c0 1 -- 10.20.193.28:0/1485820380 >> 10.20.193.28:0/1485820380 conn(0x7f160c0586e0 msgr2=0x7f160c058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.353+0000 7f1610bb06c0 1 -- 10.20.193.28:0/1485820380 shutdown_connections 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.353+0000 7f1610bb06c0 1 -- 10.20.193.28:0/1485820380 wait complete. 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.353+0000 7f1610bb06c0 1 Processor -- start 2026-02-13T01:25:50.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.353+0000 7f1610bb06c0 1 -- start start 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1610bb06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c114000 0x7f160c065dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1610bb06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f160c116b30 0x7f160c066310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f160a5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c114000 0x7f160c065dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f160a5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c114000 0x7f160c065dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56616/0 (socket says 10.20.193.28:56616) 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f160a5756c0 1 -- 10.20.193.28:0/3049887998 learned_addr learned my addr 10.20.193.28:0/3049887998 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c06b6d0 0x7f160c06bb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06c0e0 con 0x7f160c114000 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06c250 con 0x7f160c116b30 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1609d746c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f160c116b30 0x7f160c066310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f160ad766c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c06b6d0 0x7f160c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.354+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f160c06c410 con 0x7f160c06b6d0 2026-02-13T01:25:50.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160ad766c0 1 -- 10.20.193.28:0/3049887998 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f160c116b30 msgr2=0x7f160c066310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160ad766c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f160c116b30 0x7f160c066310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160ad766c0 1 -- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c114000 msgr2=0x7f160c065dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160ad766c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c114000 0x7f160c065dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160ad766c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40071c0 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160a5756c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f160c114000 0x7f160c065dd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f160ad766c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c06b6d0 0x7f160c06bb70 secure :-1 s=READY pgs=84 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1604006fd0 tx=0x7f160400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.355+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1604003c40 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.356+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc009590 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.356+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c06cba0 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.356+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f160400a070 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.356+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1604003c40 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.356+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f160c052a50 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.358+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f160400dba0 con 0x7f160c06b6d0 2026-02-13T01:25:50.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.361+0000 7f15f37fe6c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f15ec0b57f0 0x7f15ec0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1388778416' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]} : dispatch 2026-02-13T01:25:50.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]} : dispatch 2026-02-13T01:25:50.370 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T01:25:50.370 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]} : dispatch 2026-02-13T01:25:50.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.363+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f16040e4830 con 0x7f160c06b6d0 2026-02-13T01:25:50.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.363+0000 7f15f37fe6c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] conn(0x7f15ec0dd230 0x7f15ec0fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.363+0000 7f160a5756c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f15ec0b57f0 0x7f15ec0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.363+0000 7f160a5756c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f15ec0b57f0 0x7f15ec0d5ca0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15fc009350 tx=0x7f15fc0092e0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.364+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15ec0fdd90 con 0x7f15ec0dd230 2026-02-13T01:25:50.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.364+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f16040e4b60 con 0x7f160c06b6d0 2026-02-13T01:25:50.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.364+0000 7f1609d746c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] conn(0x7f15ec0dd230 0x7f15ec0fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.368+0000 7f1609d746c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] conn(0x7f15ec0dd230 0x7f15ec0fd6c0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.376+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== osd.2 v2:10.20.193.187:6800/28326527 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f15ec0fdd90 con 0x7f15ec0dd230 2026-02-13T01:25:50.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.388+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 --> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f160c052a50 con 0x7f15ec0dd230 2026-02-13T01:25:50.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.388+0000 7f15f37fe6c0 1 -- 10.20.193.28:0/3049887998 <== osd.2 v2:10.20.193.187:6800/28326527 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f160c052a50 con 0x7f15ec0dd230 2026-02-13T01:25:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] conn(0x7f15ec0dd230 msgr2=0x7f15ec0fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:6800/28326527,v1:10.20.193.187:6801/28326527] conn(0x7f15ec0dd230 0x7f15ec0fd6c0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f15ec0b57f0 msgr2=0x7f15ec0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f15ec0b57f0 0x7f15ec0d5ca0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15fc009350 tx=0x7f15fc0092e0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c06b6d0 msgr2=0x7f160c06bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f1610bb06c0 1 --2- 10.20.193.28:0/3049887998 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f160c06b6d0 0x7f160c06bb70 secure :-1 s=READY pgs=84 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1604006fd0 tx=0x7f160400cc00 comp rx=0 tx=0).stop 2026-02-13T01:25:50.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.389+0000 7f160ad766c0 1 -- 10.20.193.28:0/3049887998 reap_dead start 2026-02-13T01:25:50.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.390+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 shutdown_connections 2026-02-13T01:25:50.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.390+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 >> 10.20.193.28:0/3049887998 conn(0x7f160c0586e0 msgr2=0x7f160c117ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.390+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 shutdown_connections 2026-02-13T01:25:50.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.390+0000 7f1610bb06c0 1 -- 10.20.193.28:0/3049887998 wait complete. 2026-02-13T01:25:50.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.402+0000 7f1541f376c0 1 -- 10.20.193.28:0/1557008345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f153c1137a0 msgr2=0x7f153c113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.402+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1557008345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f153c1137a0 0x7f153c113b70 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=3980933365221016452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152c0098a0 tx=0x7f152c02ec90 comp rx=0 tx=0).stop 2026-02-13T01:25:50.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.403+0000 7f1541f376c0 1 -- 10.20.193.28:0/1557008345 shutdown_connections 2026-02-13T01:25:50.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.403+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1557008345 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c114190 0x7f153c119140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.403+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1557008345 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1198f0 0x7f153c17a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.403+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1557008345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f153c1137a0 0x7f153c113b70 unknown :-1 s=CLOSED pgs=202 gs=2 cs=0 l=1 c_cookie=3980933365221016452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.403+0000 7f1541f376c0 1 -- 10.20.193.28:0/1557008345 >> 10.20.193.28:0/1557008345 conn(0x7f153c060760 msgr2=0x7f153c060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.404+0000 7f1541f376c0 1 -- 10.20.193.28:0/1557008345 shutdown_connections 2026-02-13T01:25:50.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.404+0000 7f1541f376c0 1 -- 10.20.193.28:0/1557008345 wait complete. 2026-02-13T01:25:50.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.406+0000 7f1541f376c0 1 Processor -- start 2026-02-13T01:25:50.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.406+0000 7f1541f376c0 1 -- start start 2026-02-13T01:25:50.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.407+0000 7f1541f376c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1137a0 0x7f153c121630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.407+0000 7f1541f376c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c1198f0 0x7f153c121b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.407+0000 7f1541f376c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f153c126f30 0x7f153c1273d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.407+0000 7f1541f376c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f153c127940 con 0x7f153c126f30 2026-02-13T01:25:50.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.407+0000 7f1541f376c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f153c127ab0 con 0x7f153c1137a0 2026-02-13T01:25:50.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.407+0000 7f1541f376c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f153c127c70 con 0x7f153c1198f0 2026-02-13T01:25:50.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.408+0000 7f153b7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1137a0 0x7f153c121630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153affd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c1198f0 0x7f153c121b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153affd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c1198f0 0x7f153c121b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:49954/0 (socket says 10.20.193.28:49954) 2026-02-13T01:25:50.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153affd6c0 1 -- 10.20.193.28:0/1444976914 learned_addr learned my addr 10.20.193.28:0/1444976914 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153b7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1137a0 0x7f153c121630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52346/0 (socket says 10.20.193.28:52346) 2026-02-13T01:25:50.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153b7fe6c0 1 -- 10.20.193.28:0/1444976914 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c1198f0 msgr2=0x7f153c121b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153b7fe6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c1198f0 0x7f153c121b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153b7fe6c0 1 -- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f153c126f30 msgr2=0x7f153c1273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153b7fe6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f153c126f30 0x7f153c1273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153affd6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f153c1198f0 0x7f153c121b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:50.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.409+0000 7f153b7fe6c0 1 -- 10.20.193.28:0/1444976914 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c0094c0 con 0x7f153c1137a0 2026-02-13T01:25:50.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.413+0000 7f153b7fe6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1137a0 0x7f153c121630 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152c02f1a0 tx=0x7f152c02fbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.413+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f152c005250 con 0x7f153c1137a0 2026-02-13T01:25:50.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.413+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f152c002da0 con 0x7f153c1137a0 2026-02-13T01:25:50.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.413+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f152c007440 con 0x7f153c1137a0 2026-02-13T01:25:50.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.415+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153c1680c0 con 0x7f153c1137a0 2026-02-13T01:25:50.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.416+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f153c1684f0 con 0x7f153c1137a0 2026-02-13T01:25:50.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.416+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f153c052a50 con 0x7f153c1137a0 2026-02-13T01:25:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.418+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f152c0053b0 con 0x7f153c1137a0 2026-02-13T01:25:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f1538ff96c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f150c0b5860 0x7f150c0d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f152c107e40 con 0x7f153c1137a0 2026-02-13T01:25:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f1538ff96c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] conn(0x7f150c0dd2a0 0x7f150c0fd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 --> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f150c0fde00 con 0x7f150c0dd2a0 2026-02-13T01:25:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.421+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f152c0ca740 con 0x7f153c1137a0 2026-02-13T01:25:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.421+0000 7f153affd6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f150c0b5860 0x7f150c0d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.421+0000 7f153bfff6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] conn(0x7f150c0dd2a0 0x7f150c0fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.422+0000 7f153affd6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f150c0b5860 0x7f150c0d5d10 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f153c127fc0 tx=0x7f1528009470 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.419+0000 7f765e3136c0 1 -- 10.20.193.28:0/2090936755 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 msgr2=0x7f7658113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.419+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2090936755 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 0x7f7658113dc0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=8660193768934443493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c009970 tx=0x7f764c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:50.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 -- 10.20.193.28:0/2090936755 shutdown_connections 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2090936755 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f765815dfa0 0x7f765817e380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2090936755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7658114300 0x7f7658114730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2090936755 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 0x7f7658113dc0 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=8660193768934443493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 -- 10.20.193.28:0/2090936755 >> 10.20.193.28:0/2090936755 conn(0x7f765805aaa0 msgr2=0x7f765805b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 -- 10.20.193.28:0/2090936755 shutdown_connections 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.420+0000 7f765e3136c0 1 -- 10.20.193.28:0/2090936755 wait complete. 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.421+0000 7f765e3136c0 1 Processor -- start 2026-02-13T01:25:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.421+0000 7f765e3136c0 1 -- start start 2026-02-13T01:25:50.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.422+0000 7f765e3136c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7658114300 0x7f76580fd1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765e3136c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 0x7f76580fd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765e3136c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f765815dfa0 0x7f7658102af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765e3136c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7658103140 con 0x7f7658114300 2026-02-13T01:25:50.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765e3136c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76581032b0 con 0x7f7658117320 2026-02-13T01:25:50.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765e3136c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7658103470 con 0x7f765815dfa0 2026-02-13T01:25:50.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.425+0000 7f153bfff6c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] conn(0x7f150c0dd2a0 0x7f150c0fd730 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765db126c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f765815dfa0 0x7f7658102af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765db126c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f765815dfa0 0x7f7658102af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:49966/0 (socket says 10.20.193.28:49966) 2026-02-13T01:25:50.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765db126c0 1 -- 10.20.193.28:0/2543471660 learned_addr learned my addr 10.20.193.28:0/2543471660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765cb106c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 0x7f76580fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765d3116c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7658114300 0x7f76580fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765d3116c0 1 -- 10.20.193.28:0/2543471660 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f765815dfa0 msgr2=0x7f7658102af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765d3116c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f765815dfa0 0x7f7658102af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.423+0000 7f765d3116c0 1 -- 10.20.193.28:0/2543471660 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 msgr2=0x7f76580fd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.425+0000 7f765d3116c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 0x7f76580fd730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.425+0000 7f765d3116c0 1 -- 10.20.193.28:0/2543471660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c009590 con 0x7f7658114300 2026-02-13T01:25:50.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.425+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== osd.4 v2:10.20.193.134:6808/2852482005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f150c0fde00 con 0x7f150c0dd2a0 2026-02-13T01:25:50.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.425+0000 7f765cb106c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7658117320 0x7f76580fd730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.428+0000 7f765d3116c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7658114300 0x7f76580fd1f0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c02f960 tx=0x7f764c02fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.431+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f764c03ce80 con 0x7f7658114300 2026-02-13T01:25:50.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.435+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f764c0046b0 con 0x7f7658114300 2026-02-13T01:25:50.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.435+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f764c007b80 con 0x7f7658114300 2026-02-13T01:25:50.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.435+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76581036f0 con 0x7f7658114300 2026-02-13T01:25:50.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.435+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7658103970 con 0x7f7658114300 2026-02-13T01:25:50.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.438+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f764c03f070 con 0x7f7658114300 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.440+0000 7f76467fc6c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f76280b5860 0x7f76280d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.440+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7658052a50 con 0x7f7658114300 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.440+0000 7f765cb106c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f76280b5860 0x7f76280d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.440+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f764c1118a0 con 0x7f7658114300 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.441+0000 7f76467fc6c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] conn(0x7f76280dd2a0 0x7f76280fd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.441+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 --> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76280fde00 con 0x7f76280dd2a0 2026-02-13T01:25:50.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.441+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f764c0d41a0 con 0x7f7658114300 2026-02-13T01:25:50.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.441+0000 7f765db126c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] conn(0x7f76280dd2a0 0x7f76280fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.446+0000 7f765cb106c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f76280b5860 0x7f76280d5d10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7658103b80 tx=0x7f7648005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.450+0000 7f765db126c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] conn(0x7f76280dd2a0 0x7f76280fd730 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.451+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== osd.9 v2:10.20.193.28:6826/1895700373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f76280fde00 con 0x7f76280dd2a0 2026-02-13T01:25:50.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.459+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 --> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76580f8950 con 0x7f76280dd2a0 2026-02-13T01:25:50.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.460+0000 7f76467fc6c0 1 -- 10.20.193.28:0/2543471660 <== osd.9 v2:10.20.193.28:6826/1895700373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f76580f8950 con 0x7f76280dd2a0 2026-02-13T01:25:50.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.460+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] conn(0x7f76280dd2a0 msgr2=0x7f76280fd730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.460+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6826/1895700373,v1:10.20.193.28:6827/1895700373] conn(0x7f76280dd2a0 0x7f76280fd730 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f76280b5860 msgr2=0x7f76280d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f76280b5860 0x7f76280d5d10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7658103b80 tx=0x7f7648005f10 comp rx=0 tx=0).stop 2026-02-13T01:25:50.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7658114300 msgr2=0x7f76580fd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765e3136c0 1 --2- 10.20.193.28:0/2543471660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7658114300 0x7f76580fd1f0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f764c02f960 tx=0x7f764c02fc70 comp rx=0 tx=0).stop 2026-02-13T01:25:50.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765db126c0 1 -- 10.20.193.28:0/2543471660 reap_dead start 2026-02-13T01:25:50.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 shutdown_connections 2026-02-13T01:25:50.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.461+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 >> 10.20.193.28:0/2543471660 conn(0x7f765805aaa0 msgr2=0x7f76580f7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.462+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 shutdown_connections 2026-02-13T01:25:50.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.462+0000 7f765e3136c0 1 -- 10.20.193.28:0/2543471660 wait complete. 2026-02-13T01:25:50.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.466+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 --> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f153c17da50 con 0x7f150c0dd2a0 2026-02-13T01:25:50.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.466+0000 7f1538ff96c0 1 -- 10.20.193.28:0/1444976914 <== osd.4 v2:10.20.193.134:6808/2852482005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f153000a240 con 0x7f150c0dd2a0 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] conn(0x7f150c0dd2a0 msgr2=0x7f150c0fd730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:6808/2852482005,v1:10.20.193.134:6809/2852482005] conn(0x7f150c0dd2a0 0x7f150c0fd730 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f150c0b5860 msgr2=0x7f150c0d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f150c0b5860 0x7f150c0d5d10 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f153c127fc0 tx=0x7f1528009470 comp rx=0 tx=0).stop 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1137a0 msgr2=0x7f153c121630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f1541f376c0 1 --2- 10.20.193.28:0/1444976914 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f153c1137a0 0x7f153c121630 secure :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152c02f1a0 tx=0x7f152c02fbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.472+0000 7f153bfff6c0 1 -- 10.20.193.28:0/1444976914 reap_dead start 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.473+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 shutdown_connections 2026-02-13T01:25:50.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.473+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 >> 10.20.193.28:0/1444976914 conn(0x7f153c060760 msgr2=0x7f153c116a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.473+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 shutdown_connections 2026-02-13T01:25:50.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.473+0000 7f1541f376c0 1 -- 10.20.193.28:0/1444976914 wait complete. 2026-02-13T01:25:50.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.487+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/3128897790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28114000 msgr2=0x7faa281143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.487+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/3128897790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28114000 0x7faa281143d0 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=2802362657982697208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa1800aca0 tx=0x7faa18030060 comp rx=0 tx=0).stop 2026-02-13T01:25:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/3128897790 shutdown_connections 2026-02-13T01:25:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/3128897790 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa28116b30 0x7faa2817a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/3128897790 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa281149f0 0x7faa28116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/3128897790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28114000 0x7faa281143d0 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=2802362657982697208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/3128897790 >> 10.20.193.28:0/3128897790 conn(0x7faa280586e0 msgr2=0x7faa28058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/3128897790 shutdown_connections 2026-02-13T01:25:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/3128897790 wait complete. 2026-02-13T01:25:50.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/328179118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4114000 msgr2=0x7f0ba41143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 --2- 10.20.193.28:0/328179118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4114000 0x7f0ba41143d0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=14530829901098124935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b98009970 tx=0x7f0b9802ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/328179118 shutdown_connections 2026-02-13T01:25:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 --2- 10.20.193.28:0/328179118 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0ba4119900 0x7f0ba411a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.490+0000 7faa2cb2c6c0 1 Processor -- start 2026-02-13T01:25:50.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7f98897b96c0 1 -- 10.20.193.28:0/3139730897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 msgr2=0x7f9884116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.488+0000 7f98897b96c0 1 --2- 10.20.193.28:0/3139730897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f9884116df0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=177202548237978290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f987400aa40 tx=0x7f987402fe00 comp rx=0 tx=0).stop 2026-02-13T01:25:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.490+0000 7faa2cb2c6c0 1 -- start start 2026-02-13T01:25:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7faa2cb2c6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa28114000 0x7faa2811dff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7faa2cb2c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28116b30 0x7faa2811e530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7faa2cb2c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa281238f0 0x7faa28123d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7faa2cb2c6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa28124300 con 0x7faa28116b30 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7faa2cb2c6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa28124470 con 0x7faa281238f0 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7faa2cb2c6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa28124630 con 0x7faa28114000 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa25d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28116b30 0x7faa2811e530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa25d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28116b30 0x7faa2811e530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56728/0 (socket says 10.20.193.28:56728) 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa25d746c0 1 -- 10.20.193.28:0/846532871 learned_addr learned my addr 10.20.193.28:0/846532871 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa25d746c0 1 -- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa28114000 msgr2=0x7faa2811dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa26d766c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa281238f0 0x7faa28123d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 --2- 10.20.193.28:0/328179118 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba41149f0 0x7f0ba4119150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 --2- 10.20.193.28:0/328179118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4114000 0x7f0ba41143d0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=14530829901098124935 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.489+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/328179118 >> 10.20.193.28:0/328179118 conn(0x7f0ba40586e0 msgr2=0x7f0ba4058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.490+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/328179118 shutdown_connections 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.490+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/328179118 wait complete. 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7f0baaf7d6c0 1 Processor -- start 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.491+0000 7f0baaf7d6c0 1 -- start start 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0baaf7d6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba4114000 0x7f0ba412b870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0baaf7d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4119900 0x7f0ba412bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0baaf7d6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0ba4131170 0x7f0ba4131610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0baaf7d6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba4131b80 con 0x7f0ba4119900 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0baaf7d6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba4131cf0 con 0x7f0ba4114000 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0baaf7d6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba4131eb0 con 0x7f0ba4131170 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0ba8cee6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba4114000 0x7f0ba412b870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0ba8cee6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba4114000 0x7f0ba412b870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52440/0 (socket says 10.20.193.28:52440) 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0ba8cee6c0 1 -- 10.20.193.28:0/3517618186 learned_addr learned my addr 10.20.193.28:0/3517618186 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0ba94ef6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0ba4131170 0x7f0ba4131610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7f0ba8cee6c0 1 -- 10.20.193.28:0/3517618186 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0ba4131170 msgr2=0x7f0ba4131610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 -- 10.20.193.28:0/3139730897 shutdown_connections 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 --2- 10.20.193.28:0/3139730897 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9884118f30 0x7f9884119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 --2- 10.20.193.28:0/3139730897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f9884116df0 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=177202548237978290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 --2- 10.20.193.28:0/3139730897 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f988411b3f0 0x7f988411b7c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 -- 10.20.193.28:0/3139730897 >> 10.20.193.28:0/3139730897 conn(0x7f988405b290 msgr2=0x7f988405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 -- 10.20.193.28:0/3139730897 shutdown_connections 2026-02-13T01:25:50.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.493+0000 7f98897b96c0 1 -- 10.20.193.28:0/3139730897 wait complete. 2026-02-13T01:25:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa25d746c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa28114000 0x7faa2811dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.492+0000 7faa25d746c0 1 -- 10.20.193.28:0/846532871 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa281238f0 msgr2=0x7faa28123d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.494+0000 7f98897b96c0 1 Processor -- start 2026-02-13T01:25:50.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.494+0000 7f98897b96c0 1 -- start start 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.494+0000 7f98897b96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9884118f30 0x7f988412ba20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.494+0000 7f98897b96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f988412bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98897b96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988411b3f0 0x7f9884131320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98897b96c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9884131970 con 0x7f98841199a0 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98897b96c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9884131ae0 con 0x7f9884118f30 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98897b96c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9884131ca0 con 0x7f988411b3f0 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f988412bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f988412bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56750/0 (socket says 10.20.193.28:56750) 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 -- 10.20.193.28:0/23545864 learned_addr learned my addr 10.20.193.28:0/23545864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 -- 10.20.193.28:0/23545864 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988411b3f0 msgr2=0x7f9884131320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:50.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988411b3f0 0x7f9884131320 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 -- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9884118f30 msgr2=0x7f988412ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9884118f30 0x7f988412ba20 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f98827fc6c0 1 -- 10.20.193.28:0/23545864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987400a660 con 0x7f98841199a0 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.496+0000 7f98827fc6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f988412bf60 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f986c00b800 tx=0x7f986c00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f0ba3fff6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4119900 0x7f0ba412bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f0ba8cee6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0ba4131170 0x7f0ba4131610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7f0ba8cee6c0 1 -- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4119900 msgr2=0x7f0ba412bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.496+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f986c004310 con 0x7f98841199a0 2026-02-13T01:25:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.496+0000 7f0ba8cee6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4119900 0x7f0ba412bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.496+0000 7f0ba8cee6c0 1 -- 10.20.193.28:0/3517618186 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b98009590 con 0x7f0ba4114000 2026-02-13T01:25:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.496+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9884131f80 con 0x7f98841199a0 2026-02-13T01:25:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.498+0000 7f0ba3fff6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ba4119900 0x7f0ba412bdb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.497+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f986c004470 con 0x7f98841199a0 2026-02-13T01:25:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.497+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f986c004310 con 0x7f98841199a0 2026-02-13T01:25:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.498+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9884172660 con 0x7f98841199a0 2026-02-13T01:25:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.498+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9884052a50 con 0x7f98841199a0 2026-02-13T01:25:50.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.498+0000 7faa25d746c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa281238f0 0x7faa28123d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7fa9efde06c0 1 -- 10.20.193.28:0/4077148042 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8116b30 msgr2=0x7fa9e817a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.495+0000 7fa9efde06c0 1 --2- 10.20.193.28:0/4077148042 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8116b30 0x7fa9e817a760 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=8309734208468521862 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9e0006fd0 tx=0x7fa9e002fd50 comp rx=0 tx=0).stop 2026-02-13T01:25:50.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.499+0000 7fa9efde06c0 1 -- 10.20.193.28:0/4077148042 shutdown_connections 2026-02-13T01:25:50.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.498+0000 7faa25d746c0 1 -- 10.20.193.28:0/846532871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1800a660 con 0x7faa28116b30 2026-02-13T01:25:50.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.499+0000 7faa26d766c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa281238f0 0x7faa28123d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.499+0000 7f0ba8cee6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba4114000 0x7f0ba412b870 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b980098c0 tx=0x7f0b9802fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.499+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b98002ae0 con 0x7f0ba4114000 2026-02-13T01:25:50.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.499+0000 7fa9efde06c0 1 --2- 10.20.193.28:0/4077148042 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8116b30 0x7fa9e817a760 unknown :-1 s=CLOSED pgs=81 gs=2 cs=0 l=1 c_cookie=8309734208468521862 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0b98002c40 con 0x7f0ba4114000 2026-02-13T01:25:50.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7faa25d746c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28116b30 0x7faa2811e530 secure :-1 s=READY pgs=208 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa10009560 tx=0x7faa1000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b98037410 con 0x7f0ba4114000 2026-02-13T01:25:50.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/3517618186 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba4172300 con 0x7f0ba4114000 2026-02-13T01:25:50.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7fa9efde06c0 1 --2- 10.20.193.28:0/4077148042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9e81149f0 0x7fa9e8116380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa10004a80 con 0x7faa28116b30 2026-02-13T01:25:50.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7fa9efde06c0 1 --2- 10.20.193.28:0/4077148042 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa9e8114000 0x7fa9e81143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7fa9efde06c0 1 -- 10.20.193.28:0/4077148042 >> 10.20.193.28:0/4077148042 conn(0x7fa9e80586e0 msgr2=0x7fa9e8058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.501+0000 7fa9efde06c0 1 -- 10.20.193.28:0/4077148042 shutdown_connections 2026-02-13T01:25:50.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/3517618186 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba4172730 con 0x7f0ba4114000 2026-02-13T01:25:50.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.501+0000 7fa9efde06c0 1 -- 10.20.193.28:0/4077148042 wait complete. 2026-02-13T01:25:50.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.500+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faa10009030 con 0x7faa28116b30 2026-02-13T01:25:50.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.501+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa1000ce70 con 0x7faa28116b30 2026-02-13T01:25:50.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.501+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa28164ae0 con 0x7faa28116b30 2026-02-13T01:25:50.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.501+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa28164f40 con 0x7faa28116b30 2026-02-13T01:25:50.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.502+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/3517618186 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ba4052a50 con 0x7f0ba4114000 2026-02-13T01:25:50.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.502+0000 7fa9efde06c0 1 Processor -- start 2026-02-13T01:25:50.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.503+0000 7fa9efde06c0 1 -- start start 2026-02-13T01:25:50.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.503+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa28052a50 con 0x7faa28116b30 2026-02-13T01:25:50.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.502+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f986c00cb60 con 0x7f98841199a0 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.503+0000 7f9863fff6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5770 0x7f98540d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f986c007af0 con 0x7f98841199a0 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7f9863fff6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] conn(0x7f98540dd1b0 0x7f98540fd640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 --> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98540fdd10 con 0x7f98540dd1b0 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f986c0a6030 con 0x7f98841199a0 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7f9882ffd6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5770 0x7f98540d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.505+0000 7f9882ffd6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5770 0x7f98540d5c20 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9878004770 tx=0x7f9878006c90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.505+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7faa10004be0 con 0x7faa28116b30 2026-02-13T01:25:50.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7faa177fe6c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9f80b56e0 0x7fa9f80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7faa100e3c60 con 0x7faa28116b30 2026-02-13T01:25:50.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.506+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f0b98007260 con 0x7f0ba4114000 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.503+0000 7fa9efde06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8114000 0x7fa9e80fa970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.503+0000 7fa9efde06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9e8116b30 0x7fa9e80faeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.503+0000 7fa9efde06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa9e8100270 0x7fa9e8100710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9efde06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e8100c80 con 0x7fa9e8116b30 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9efde06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e8100df0 con 0x7fa9e8114000 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9efde06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e8100fb0 con 0x7fa9e8100270 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8114000 0x7fa9e80fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8114000 0x7fa9e80fa970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52456/0 (socket says 10.20.193.28:52456) 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 -- 10.20.193.28:0/2421082134 learned_addr learned my addr 10.20.193.28:0/2421082134 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9ed3546c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9e8116b30 0x7fa9e80faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 -- 10.20.193.28:0/2421082134 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa9e8100270 msgr2=0x7fa9e8100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa9e8100270 0x7fa9e8100710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 -- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9e8116b30 msgr2=0x7fa9e80faeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9e8116b30 0x7fa9e80faeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9edb556c0 1 -- 10.20.193.28:0/2421082134 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc009590 con 0x7fa9e8114000 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.504+0000 7fa9ed3546c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9e8116b30 0x7fa9e80faeb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.505+0000 7fa9edb556c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8114000 0x7fa9e80fa970 secure :-1 s=READY pgs=83 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d800b710 tx=0x7fa9d800bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7faa265756c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9f80b56e0 0x7fa9f80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9d8004250 con 0x7fa9e8114000 2026-02-13T01:25:50.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9d8009070 con 0x7fa9e8114000 2026-02-13T01:25:50.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7fa9efde06c0 1 -- 10.20.193.28:0/2421082134 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e000a5b0 con 0x7fa9e8114000 2026-02-13T01:25:50.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7fa9efde06c0 1 -- 10.20.193.28:0/2421082134 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e8101790 con 0x7fa9e8114000 2026-02-13T01:25:50.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.507+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9d800ccd0 con 0x7fa9e8114000 2026-02-13T01:25:50.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.508+0000 7faa177fe6c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] conn(0x7fa9f80dcfb0 0x7fa9f80fd440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.508+0000 7f98837fe6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] conn(0x7f98540dd1b0 0x7f98540fd640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.509+0000 7f0ba1ffb6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0b7c0b5860 0x7f0b7c0d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.508+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 --> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9f80fdb10 con 0x7fa9f80dcfb0 2026-02-13T01:25:50.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.509+0000 7faa265756c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9f80b56e0 0x7fa9f80d5b90 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa18006c20 tx=0x7faa18008200 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.509+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7faa100e4080 con 0x7faa28116b30 2026-02-13T01:25:50.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.509+0000 7faa26d766c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] conn(0x7fa9f80dcfb0 0x7fa9f80fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.509+0000 7fa9efde06c0 1 -- 10.20.193.28:0/2421082134 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9e8052a50 con 0x7fa9e8114000 2026-02-13T01:25:50.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.509+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f0b98107f70 con 0x7f0ba4114000 2026-02-13T01:25:50.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7f0ba1ffb6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] conn(0x7f0b7c0dd2a0 0x7f0b7c0fd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 --> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b7c0fde00 con 0x7f0b7c0dd2a0 2026-02-13T01:25:50.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f0b9810a530 con 0x7f0ba4114000 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faa26d766c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] conn(0x7fa9f80dcfb0 0x7fa9f80fd440 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 -- 10.20.193.28:0/3558637017 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae410f200 msgr2=0x7faae410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3558637017 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae410f200 0x7faae410f5d0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=8649922218432110893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad8009970 tx=0x7faad802ed70 comp rx=0 tx=0).stop 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 -- 10.20.193.28:0/3558637017 shutdown_connections 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3558637017 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faae4115410 0x7faae4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3558637017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410fbf0 0x7faae4114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3558637017 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae410f200 0x7faae410f5d0 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=8649922218432110893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 -- 10.20.193.28:0/3558637017 >> 10.20.193.28:0/3558637017 conn(0x7faae40ecb00 msgr2=0x7faae410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 -- 10.20.193.28:0/3558637017 shutdown_connections 2026-02-13T01:25:50.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.510+0000 7faae956b6c0 1 -- 10.20.193.28:0/3558637017 wait complete. 2026-02-13T01:25:50.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== osd.8 v2:10.20.193.187:6816/2802029994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa9f80fdb10 con 0x7fa9f80dcfb0 2026-02-13T01:25:50.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 Processor -- start 2026-02-13T01:25:50.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7f98837fe6c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] conn(0x7f98540dd1b0 0x7f98540fd640 crc :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7f0ba94ef6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] conn(0x7f0b7c0dd2a0 0x7f0b7c0fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 -- start start 2026-02-13T01:25:50.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410f200 0x7faae40f8f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae4115410 0x7faae4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faae40f95a0 0x7faae40fe820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faae40f9c90 con 0x7faae410f200 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7faae40fed60 con 0x7faae4115410 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.511+0000 7faae956b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7faae40fef20 con 0x7faae40f95a0 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410f200 0x7faae40f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410f200 0x7faae40f8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56770/0 (socket says 10.20.193.28:56770) 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 -- 10.20.193.28:0/3780890545 learned_addr learned my addr 10.20.193.28:0/3780890545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae37fe6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faae40f95a0 0x7faae40fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae27fc6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae4115410 0x7faae4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== osd.1 v2:10.20.193.134:6800/2922978638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f98540fdd10 con 0x7f98540dd1b0 2026-02-13T01:25:50.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fa9d80028c0 con 0x7fa9e8114000 2026-02-13T01:25:50.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 -- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faae40f95a0 msgr2=0x7faae40fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faae40f95a0 0x7faae40fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 -- 10.20.193.28:0/3780890545 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae4115410 msgr2=0x7faae4175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faae4115410 0x7faae4175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.512+0000 7faae2ffd6c0 1 -- 10.20.193.28:0/3780890545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad8009590 con 0x7faae410f200 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.513+0000 7faae2ffd6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410f200 0x7faae40f8f70 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad80092b0 tx=0x7faad802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.513+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad8002ae0 con 0x7faae410f200 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.513+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faad8002c40 con 0x7faae410f200 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.513+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae40ff1a0 con 0x7faae410f200 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.513+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae40ff670 con 0x7faae410f200 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.513+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad80362f0 con 0x7faae410f200 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.514+0000 7f0ba3fff6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0b7c0b5860 0x7f0b7c0d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.514+0000 7f0ba94ef6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] conn(0x7f0b7c0dd2a0 0x7f0b7c0fd730 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.515+0000 7f0ba3fff6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0b7c0b5860 0x7f0b7c0d5d10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ba4132200 tx=0x7f0b8c005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.515+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== osd.10 v2:10.20.193.134:6824/1465401365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f0b7c0fde00 con 0x7f0b7c0dd2a0 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.516+0000 7faac1ffb6c0 1 -- 10.20.193.28:0/3780890545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faae4052a50 con 0x7faae410f200 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.514+0000 7fa9d6ffd6c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9bc0b5710 0x7fa9bc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.514+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7fa9d80e3d80 con 0x7fa9e8114000 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.515+0000 7fa9d6ffd6c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] conn(0x7fa9bc0dd150 0x7fa9bc0fd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.515+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 --> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9bc0fdcb0 con 0x7fa9bc0dd150 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.515+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa9d80e4130 con 0x7fa9e8114000 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.516+0000 7fa9ed3546c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9bc0b5710 0x7fa9bc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.516+0000 7fa9ee3566c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] conn(0x7fa9bc0dd150 0x7fa9bc0fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.516+0000 7fa9ed3546c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9bc0b5710 0x7fa9bc0d5bc0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9e8101300 tx=0x7fa9dc009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.516+0000 7fa9ee3566c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] conn(0x7fa9bc0dd150 0x7fa9bc0fd5e0 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.517+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7faad8007860 con 0x7faae410f200 2026-02-13T01:25:50.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.518+0000 7faac3fff6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab80b5710 0x7faab80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.518+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7faad8107e00 con 0x7faae410f200 2026-02-13T01:25:50.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.519+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== osd.3 v2:10.20.193.28:6810/3039326126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa9bc0fdcb0 con 0x7fa9bc0dd150 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.518+0000 7faac3fff6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] conn(0x7faab80dd150 0x7faab80fd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.518+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 --> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faab80fdcb0 con 0x7faab80dd150 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.518+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7faad810a440 con 0x7faae410f200 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.519+0000 7faae27fc6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab80b5710 0x7faab80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.519+0000 7faae37fe6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] conn(0x7faab80dd150 0x7faab80fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.519+0000 7faae27fc6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab80b5710 0x7faab80d5bc0 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae40ff8b0 tx=0x7faacc0094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.520+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 --> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa28052a50 con 0x7fa9f80dcfb0 2026-02-13T01:25:50.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.520+0000 7faae37fe6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] conn(0x7faab80dd150 0x7faab80fd5e0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.520+0000 7faa177fe6c0 1 -- 10.20.193.28:0/846532871 <== osd.8 v2:10.20.193.187:6816/2802029994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa28052a50 con 0x7fa9f80dcfb0 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.521+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== osd.5 v2:10.20.193.187:6808/3424321792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7faab80fdcb0 con 0x7faab80dd150 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] conn(0x7fa9f80dcfb0 msgr2=0x7fa9f80fd440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.187:6816/2802029994,v1:10.20.193.187:6817/2802029994] conn(0x7fa9f80dcfb0 0x7fa9f80fd440 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9f80b56e0 msgr2=0x7fa9f80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9f80b56e0 0x7fa9f80d5b90 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa18006c20 tx=0x7faa18008200 comp rx=0 tx=0).stop 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28116b30 msgr2=0x7faa2811e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 --2- 10.20.193.28:0/846532871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa28116b30 0x7faa2811e530 secure :-1 s=READY pgs=208 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa10009560 tx=0x7faa1000bbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa26d766c0 1 -- 10.20.193.28:0/846532871 reap_dead start 2026-02-13T01:25:50.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.530+0000 7fa9efde06c0 1 -- 10.20.193.28:0/2421082134 --> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9e817d900 con 0x7fa9bc0dd150 2026-02-13T01:25:50.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0baaf7d6c0 1 -- 10.20.193.28:0/3517618186 --> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ba4186420 con 0x7f0b7c0dd2a0 2026-02-13T01:25:50.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7fa9d6ffd6c0 1 -- 10.20.193.28:0/2421082134 <== osd.3 v2:10.20.193.28:6810/3039326126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa9e817d900 con 0x7fa9bc0dd150 2026-02-13T01:25:50.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0ba1ffb6c0 1 -- 10.20.193.28:0/3517618186 <== osd.10 v2:10.20.193.134:6824/1465401365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0ba4186420 con 0x7f0b7c0dd2a0 2026-02-13T01:25:50.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] conn(0x7f0b7c0dd2a0 msgr2=0x7f0b7c0fd730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 shutdown_connections 2026-02-13T01:25:50.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.524+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 >> 10.20.193.28:0/846532871 conn(0x7faa280586e0 msgr2=0x7faa28119550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.525+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 shutdown_connections 2026-02-13T01:25:50.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.525+0000 7faa2cb2c6c0 1 -- 10.20.193.28:0/846532871 wait complete. 2026-02-13T01:25:50.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:6824/1465401365,v1:10.20.193.134:6825/1465401365] conn(0x7f0b7c0dd2a0 0x7f0b7c0fd730 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0b7c0b5860 msgr2=0x7f0b7c0d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0b7c0b5860 0x7f0b7c0d5d10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ba4132200 tx=0x7f0b8c005df0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba4114000 msgr2=0x7f0ba412b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 --2- 10.20.193.28:0/3517618186 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0ba4114000 0x7f0ba412b870 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b980098c0 tx=0x7f0b9802fc90 comp rx=0 tx=0).stop 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0ba94ef6c0 1 -- 10.20.193.28:0/3517618186 reap_dead start 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 shutdown_connections 2026-02-13T01:25:50.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.531+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 >> 10.20.193.28:0/3517618186 conn(0x7f0ba40586e0 msgr2=0x7f0ba41187a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faac1ffb6c0 1 -- 10.20.193.28:0/3780890545 --> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faae4179470 con 0x7faab80dd150 2026-02-13T01:25:50.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faac3fff6c0 1 -- 10.20.193.28:0/3780890545 <== osd.5 v2:10.20.193.187:6808/3424321792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faae4179470 con 0x7faab80dd150 2026-02-13T01:25:50.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] conn(0x7faab80dd150 msgr2=0x7faab80fd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.187:6808/3424321792,v1:10.20.193.187:6809/3424321792] conn(0x7faab80dd150 0x7faab80fd5e0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/77275758 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 msgr2=0x7f939c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/77275758 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 0x7f939c175c10 secure :-1 s=READY pgs=85 gs=2 cs=0 l=1 c_cookie=16018344247657338786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f939800a9b0 tx=0x7f939802fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/77275758 shutdown_connections 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/77275758 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 0x7f939c175c10 unknown :-1 s=CLOSED pgs=85 gs=2 cs=0 l=1 c_cookie=16018344247657338786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/77275758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f939c10fa50 0x7f939c114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/77275758 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c10f060 0x7f939c10f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/77275758 >> 10.20.193.28:0/77275758 conn(0x7f939c0ec980 msgr2=0x7f939c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab80b5710 msgr2=0x7faab80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faab80b5710 0x7faab80d5bc0 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae40ff8b0 tx=0x7faacc0094b0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410f200 msgr2=0x7faae40f8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.536+0000 7faae956b6c0 1 --2- 10.20.193.28:0/3780890545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faae410f200 0x7faae40f8f70 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad80092b0 tx=0x7faad802fc60 comp rx=0 tx=0).stop 2026-02-13T01:25:50.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7faae37fe6c0 1 -- 10.20.193.28:0/3780890545 reap_dead start 2026-02-13T01:25:50.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 shutdown_connections 2026-02-13T01:25:50.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 >> 10.20.193.28:0/3780890545 conn(0x7faae40ecb00 msgr2=0x7faae4112f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 shutdown_connections 2026-02-13T01:25:50.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7faae956b6c0 1 -- 10.20.193.28:0/3780890545 wait complete. 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/77275758 shutdown_connections 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/77275758 wait complete. 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 Processor -- start 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- start start 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f939c10f060 0x7f939c05e390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 0x7f939c05b600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c05bb40 0x7f939c05bfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f939c101190 con 0x7f939c10f060 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f939c101300 con 0x7f939c05bb40 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1014c0 con 0x7f939c115270 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a0eec6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 0x7f939c05b600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c05bb40 0x7f939c05bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a16ed6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f939c10f060 0x7f939c05e390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c05bb40 0x7f939c05bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52496/0 (socket says 10.20.193.28:52496) 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 -- 10.20.193.28:0/474610037 learned_addr learned my addr 10.20.193.28:0/474610037 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 -- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 msgr2=0x7f939c05b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f939c115270 0x7f939c05b600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 -- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f939c10f060 msgr2=0x7f939c05e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f939c10f060 0x7f939c05e390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 -- 10.20.193.28:0/474610037 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c009590 con 0x7f939c05bb40 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a16ed6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f939c10f060 0x7f939c05e390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a1eee6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c05bb40 0x7f939c05bfe0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f939800a580 tx=0x7f93980055f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9398003810 con 0x7f939c05bb40 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9398003e50 con 0x7f939c05bb40 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93980392f0 con 0x7f939c05bb40 2026-02-13T01:25:50.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939800a5b0 con 0x7f939c05bb40 2026-02-13T01:25:50.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.539+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c1019b0 con 0x7f939c05bb40 2026-02-13T01:25:50.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.545+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f93980083f0 con 0x7f939c05bb40 2026-02-13T01:25:50.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.547+0000 7f938a7fc6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93740b5710 0x7f93740d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.547+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f9398108e40 con 0x7f939c05bb40 2026-02-13T01:25:50.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.547+0000 7f93a16ed6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93740b5710 0x7f93740d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.547+0000 7f93a16ed6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93740b5710 0x7f93740d5bc0 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9390004750 tx=0x7f9390009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1388778416' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T01:25:50.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]} : dispatch 2026-02-13T01:25:50.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 shutdown_connections 2026-02-13T01:25:50.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7f0b737fe6c0 1 -- 10.20.193.28:0/3517618186 wait complete. 2026-02-13T01:25:50.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] conn(0x7f939c0633d0 0x7f939c04ca20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 --> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f939c110330 con 0x7f939c0633d0 2026-02-13T01:25:50.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fde837416c0 1 -- 10.20.193.28:0/1671091949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 msgr2=0x7fde7c1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fde837416c0 1 --2- 10.20.193.28:0/1671091949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c1143d0 secure :-1 s=READY pgs=85 gs=3 cs=0 l=1 c_cookie=13134627379033572872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde7800a9b0 tx=0x7fde7802fda0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7f93a0eec6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] conn(0x7f939c0633d0 0x7f939c04ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] conn(0x7fa9bc0dd150 msgr2=0x7fa9bc0fd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9d4ff96c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6810/3039326126,v1:10.20.193.28:6811/3039326126] conn(0x7fa9bc0dd150 0x7fa9bc0fd5e0 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9bc0b5710 msgr2=0x7fa9bc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9d4ff96c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa9bc0b5710 0x7fa9bc0d5bc0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9e8101300 tx=0x7fa9dc009310 comp rx=0 tx=0).stop 2026-02-13T01:25:50.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8114000 msgr2=0x7fa9e80fa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9d4ff96c0 1 --2- 10.20.193.28:0/2421082134 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa9e8114000 0x7fa9e80fa970 secure :-1 s=READY pgs=83 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d800b710 tx=0x7fa9d800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.552+0000 7fa9ee3566c0 1 -- 10.20.193.28:0/2421082134 reap_dead start 2026-02-13T01:25:50.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.555+0000 7f93a0eec6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] conn(0x7f939c0633d0 0x7f939c04ca20 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.555+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== osd.11 v2:10.20.193.187:6824/3880817278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f939c110330 con 0x7f939c0633d0 2026-02-13T01:25:50.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7fde837416c0 1 -- 10.20.193.28:0/1671091949 shutdown_connections 2026-02-13T01:25:50.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7fde837416c0 1 --2- 10.20.193.28:0/1671091949 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fde7c1168c0 0x7fde7c116d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7fde837416c0 1 --2- 10.20.193.28:0/1671091949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde7c114910 0x7fde7c116380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7fde837416c0 1 --2- 10.20.193.28:0/1671091949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c1143d0 unknown :-1 s=CLOSED pgs=85 gs=3 cs=0 l=1 c_cookie=13134627379033572872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7fde837416c0 1 -- 10.20.193.28:0/1671091949 >> 10.20.193.28:0/1671091949 conn(0x7fde7c0586e0 msgr2=0x7fde7c058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 --> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9884115f50 con 0x7f98540dd1b0 2026-02-13T01:25:50.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7f9863fff6c0 1 -- 10.20.193.28:0/23545864 <== osd.1 v2:10.20.193.134:6800/2922978638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9884115f50 con 0x7f98540dd1b0 2026-02-13T01:25:50.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] conn(0x7f98540dd1b0 msgr2=0x7f98540fd640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.560+0000 7f98897b96c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.134:6800/2922978638,v1:10.20.193.134:6801/2922978638] conn(0x7f98540dd1b0 0x7f98540fd640 crc :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5770 msgr2=0x7f98540d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5770 0x7f98540d5c20 secure :-1 s=READY pgs=190 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9878004770 tx=0x7f9878006c90 comp rx=0 tx=0).stop 2026-02-13T01:25:50.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 msgr2=0x7f988412bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 --2- 10.20.193.28:0/23545864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f98841199a0 0x7f988412bf60 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f986c00b800 tx=0x7f986c00bcd0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98837fe6c0 1 -- 10.20.193.28:0/23545864 reap_dead start 2026-02-13T01:25:50.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 shutdown_connections 2026-02-13T01:25:50.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 >> 10.20.193.28:0/23545864 conn(0x7f988405b290 msgr2=0x7f98841145b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 shutdown_connections 2026-02-13T01:25:50.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f98897b96c0 1 -- 10.20.193.28:0/23545864 wait complete. 2026-02-13T01:25:50.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 shutdown_connections 2026-02-13T01:25:50.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 >> 10.20.193.28:0/2421082134 conn(0x7fa9e80586e0 msgr2=0x7fa9e8117360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 shutdown_connections 2026-02-13T01:25:50.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 --> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f939c10fca0 con 0x7f939c0633d0 2026-02-13T01:25:50.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f938a7fc6c0 1 -- 10.20.193.28:0/474610037 <== osd.11 v2:10.20.193.187:6824/3880817278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f939c10fca0 con 0x7f939c0633d0 2026-02-13T01:25:50.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] conn(0x7f939c0633d0 msgr2=0x7f939c04ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.187:6824/3880817278,v1:10.20.193.187:6825/3880817278] conn(0x7f939c0633d0 0x7f939c04ca20 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93740b5710 msgr2=0x7f93740d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93740b5710 0x7f93740d5bc0 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9390004750 tx=0x7f9390009390 comp rx=0 tx=0).stop 2026-02-13T01:25:50.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c05bb40 msgr2=0x7f939c05bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 --2- 10.20.193.28:0/474610037 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f939c05bb40 0x7f939c05bfe0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f939800a580 tx=0x7f93980055f0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a1eee6c0 1 -- 10.20.193.28:0/474610037 reap_dead start 2026-02-13T01:25:50.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7fa9d4ff96c0 1 -- 10.20.193.28:0/2421082134 wait complete. 2026-02-13T01:25:50.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 shutdown_connections 2026-02-13T01:25:50.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.563+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 >> 10.20.193.28:0/474610037 conn(0x7f939c0ec980 msgr2=0x7f939c10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.571+0000 7fde837416c0 1 -- 10.20.193.28:0/1671091949 shutdown_connections 2026-02-13T01:25:50.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.571+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 shutdown_connections 2026-02-13T01:25:50.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.571+0000 7f93a26ef6c0 1 -- 10.20.193.28:0/474610037 wait complete. 2026-02-13T01:25:50.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.571+0000 7fde837416c0 1 -- 10.20.193.28:0/1671091949 wait complete. 2026-02-13T01:25:50.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 -- 10.20.193.28:0/542731446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 msgr2=0x7f5370007680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/542731446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 0x7f5370007680 secure :-1 s=READY pgs=210 gs=2 cs=0 l=1 c_cookie=5207962274154241361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f536c009bd0 tx=0x7f536c02efb0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 -- 10.20.193.28:0/542731446 shutdown_connections 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/542731446 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370007bc0 0x7f537000d5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/542731446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 0x7f5370007680 unknown :-1 s=CLOSED pgs=210 gs=2 cs=0 l=1 c_cookie=5207962274154241361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/542731446 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5370006120 0x7f5370007140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.573+0000 7f5377fff6c0 1 -- 10.20.193.28:0/542731446 >> 10.20.193.28:0/542731446 conn(0x7f537001c5c0 msgr2=0x7f537001cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.574+0000 7f5377fff6c0 1 -- 10.20.193.28:0/542731446 shutdown_connections 2026-02-13T01:25:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.575+0000 7fde837416c0 1 Processor -- start 2026-02-13T01:25:50.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.575+0000 7f5377fff6c0 1 -- 10.20.193.28:0/542731446 wait complete. 2026-02-13T01:25:50.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 -- start start 2026-02-13T01:25:50.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c122760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde7c114910 0x7fde7c122ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.575+0000 7f5377fff6c0 1 Processor -- start 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7f5377fff6c0 1 -- start start 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7f5377fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 0x7f5370015f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f5377fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370006120 0x7f5370016450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f5377fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5370007bc0 0x7f53700a76e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f5377fff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53700a7d30 con 0x7f5370005a80 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f5377fff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53700a7ea0 con 0x7f5370007bc0 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f5377fff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f53700a8060 con 0x7f5370006120 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f53767fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370006120 0x7f5370016450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f53767fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370006120 0x7f5370016450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50088/0 (socket says 10.20.193.28:50088) 2026-02-13T01:25:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7f53767fc6c0 1 -- 10.20.193.28:0/2893147448 learned_addr learned my addr 10.20.193.28:0/2893147448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fde7c1168c0 0x7fde7c128060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde7c1286b0 con 0x7fde7c114910 2026-02-13T01:25:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde7c128820 con 0x7fde7c114000 2026-02-13T01:25:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.576+0000 7fde837416c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fde7c1289e0 con 0x7fde7c1168c0 2026-02-13T01:25:50.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.577+0000 7fde814b26c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c122760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7f53767fc6c0 1 -- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5370007bc0 msgr2=0x7f53700a76e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:50.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7f53767fc6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f5370007bc0 0x7f53700a76e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7f53767fc6c0 1 -- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 msgr2=0x7f5370015f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:25:50.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7fde814b26c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c122760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52516/0 (socket says 10.20.193.28:52516) 2026-02-13T01:25:50.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7fde814b26c0 1 -- 10.20.193.28:0/2445852918 learned_addr learned my addr 10.20.193.28:0/2445852918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7fde80cb16c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde7c114910 0x7fde7c122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.578+0000 7fde81cb36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fde7c1168c0 0x7fde7c128060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.579+0000 7fde814b26c0 1 -- 10.20.193.28:0/2445852918 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fde7c1168c0 msgr2=0x7fde7c128060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.579+0000 7fde814b26c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fde7c1168c0 0x7fde7c128060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.579+0000 7fde814b26c0 1 -- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde7c114910 msgr2=0x7fde7c122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.579+0000 7fde814b26c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde7c114910 0x7fde7c122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.579+0000 7fde814b26c0 1 -- 10.20.193.28:0/2445852918 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7800a5b0 con 0x7fde7c114000 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.579+0000 7fde80cb16c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde7c114910 0x7fde7c122ca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.580+0000 7fde814b26c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c122760 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde78031cb0 tx=0x7fde78031ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.580+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde78003c40 con 0x7fde7c114000 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.580+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde78003da0 con 0x7fde7c114000 2026-02-13T01:25:50.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.580+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde78039520 con 0x7fde7c114000 2026-02-13T01:25:50.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.580+0000 7f5376ffd6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 0x7f5370015f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.581+0000 7f53767fc6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 0x7f5370015f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.581+0000 7f53767fc6c0 1 -- 10.20.193.28:0/2893147448 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c009590 con 0x7f5370006120 2026-02-13T01:25:50.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.580+0000 7fde837416c0 1 -- 10.20.193.28:0/2445852918 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7c128c60 con 0x7fde7c114000 2026-02-13T01:25:50.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.581+0000 7f5376ffd6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5370005a80 0x7f5370015f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7f53767fc6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370006120 0x7f5370016450 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f536c009cd0 tx=0x7f536c031830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7fde837416c0 1 -- 10.20.193.28:0/2445852918 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde7c128ee0 con 0x7fde7c114000 2026-02-13T01:25:50.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f536c004350 con 0x7f5370006120 2026-02-13T01:25:50.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f536c02fcf0 con 0x7f5370006120 2026-02-13T01:25:50.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53700a82e0 con 0x7f5370006120 2026-02-13T01:25:50.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f536c007440 con 0x7f5370006120 2026-02-13T01:25:50.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.582+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53700a8a00 con 0x7f5370006120 2026-02-13T01:25:50.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.585+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f536c0075d0 con 0x7f5370006120 2026-02-13T01:25:50.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.585+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fde78008ad0 con 0x7fde7c114000 2026-02-13T01:25:50.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.587+0000 7f5357fff6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f534c0b5790 0x7f534c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.587+0000 7fde6a7fc6c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fde580b5790 0x7fde580d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.587+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7fde78108e30 con 0x7fde7c114000 2026-02-13T01:25:50.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.588+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7f536c1080c0 con 0x7f5370006120 2026-02-13T01:25:50.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.588+0000 7f5376ffd6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f534c0b5790 0x7f534c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.588+0000 7fde80cb16c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fde580b5790 0x7fde580d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.588+0000 7fde80cb16c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fde580b5790 0x7fde580d5c40 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde7c1290f0 tx=0x7fde70009690 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.589+0000 7f5376ffd6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f534c0b5790 0x7f534c0d5c40 secure :-1 s=READY pgs=197 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5368005980 tx=0x7f5368005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.590+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] conn(0x7f533c001600 0x7f533c021ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.590+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 --> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f533c024c10 con 0x7f533c001600 2026-02-13T01:25:50.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.590+0000 7f53777fe6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] conn(0x7f533c001600 0x7f533c021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.591+0000 7f53777fe6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] conn(0x7f533c001600 0x7f533c021ab0 crc :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.592+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== osd.7 v2:10.20.193.134:6816/55376257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f533c024c10 con 0x7f533c001600 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fa204b746c0 1 -- 10.20.193.28:0/2904662572 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001157c0 msgr2=0x7fa200115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2904662572 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001157c0 0x7fa200115b90 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=15117720980692086570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f400aa40 tx=0x7fa1f402fdf0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fa204b746c0 1 -- 10.20.193.28:0/2904662572 shutdown_connections 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2904662572 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa20015ad70 0x7fa20017b150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2904662572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2001160d0 0x7fa20015a830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2904662572 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001157c0 0x7fa200115b90 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=15117720980692086570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.595+0000 7fa204b746c0 1 -- 10.20.193.28:0/2904662572 >> 10.20.193.28:0/2904662572 conn(0x7fa200059bb0 msgr2=0x7fa20005a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.595+0000 7fa204b746c0 1 -- 10.20.193.28:0/2904662572 shutdown_connections 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.595+0000 7fa204b746c0 1 -- 10.20.193.28:0/2904662572 wait complete. 2026-02-13T01:25:50.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.596+0000 7fa204b746c0 1 Processor -- start 2026-02-13T01:25:50.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fde837416c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] conn(0x7fde7c04ca20 0x7fde7c04cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.594+0000 7fde837416c0 1 -- 10.20.193.28:0/2445852918 --> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde7c17ea60 con 0x7fde7c04ca20 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.597+0000 7fa204b746c0 1 -- start start 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.597+0000 7fa204b746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2001157c0 0x7fa20015eb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.597+0000 7fa204b746c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001160d0 0x7fa20015f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.597+0000 7fa204b746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa20015ad70 0x7fa200164430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.598+0000 7fa1feffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001160d0 0x7fa20015f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.598+0000 7fa204b746c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa200164a80 con 0x7fa2001157c0 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.598+0000 7fa204b746c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa200164bf0 con 0x7fa2001160d0 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.598+0000 7fa204b746c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa200164db0 con 0x7fa20015ad70 2026-02-13T01:25:50.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.599+0000 7fa1feffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001160d0 0x7fa20015f070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52546/0 (socket says 10.20.193.28:52546) 2026-02-13T01:25:50.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.599+0000 7fa1feffd6c0 1 -- 10.20.193.28:0/2732147576 learned_addr learned my addr 10.20.193.28:0/2732147576 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:50.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.599+0000 7fa1ff7fe6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2001157c0 0x7fa20015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.599+0000 7fa1feffd6c0 1 -- 10.20.193.28:0/2732147576 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa20015ad70 msgr2=0x7fa200164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.600+0000 7fa1fffff6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa20015ad70 0x7fa200164430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.600+0000 7fa1feffd6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa20015ad70 0x7fa200164430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.600+0000 7fa1feffd6c0 1 -- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2001157c0 msgr2=0x7fa20015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.600+0000 7fa1feffd6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2001157c0 0x7fa20015eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.600+0000 7fa1feffd6c0 1 -- 10.20.193.28:0/2732147576 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f00094c0 con 0x7fa2001160d0 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.601+0000 7fa1ff7fe6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2001157c0 0x7fa20015eb30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.601+0000 7fa1fffff6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa20015ad70 0x7fa200164430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.600+0000 7fde81cb36c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] conn(0x7fde7c04ca20 0x7fde7c04cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.601+0000 7fde81cb36c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] conn(0x7fde7c04ca20 0x7fde7c04cdf0 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.602+0000 7fa1feffd6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001160d0 0x7fa20015f070 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f000ba30 tx=0x7fa1f000bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.604+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1f00044a0 con 0x7fa2001160d0 2026-02-13T01:25:50.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.604+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa1f0009030 con 0x7fa2001160d0 2026-02-13T01:25:50.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.604+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1f00071c0 con 0x7fa2001160d0 2026-02-13T01:25:50.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.604+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 --> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f533c023ca0 con 0x7f533c001600 2026-02-13T01:25:50.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.604+0000 7f5357fff6c0 1 -- 10.20.193.28:0/2893147448 <== osd.7 v2:10.20.193.134:6816/55376257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f533c023ca0 con 0x7f533c001600 2026-02-13T01:25:50.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.605+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f400a660 con 0x7fa2001160d0 2026-02-13T01:25:50.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.605+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa200156710 con 0x7fa2001160d0 2026-02-13T01:25:50.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.606+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] conn(0x7f533c001600 msgr2=0x7f533c021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.606+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.134:6816/55376257,v1:10.20.193.134:6817/55376257] conn(0x7f533c001600 0x7f533c021ab0 crc :-1 s=READY pgs=9 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f534c0b5790 msgr2=0x7f534c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f534c0b5790 0x7f534c0d5c40 secure :-1 s=READY pgs=197 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5368005980 tx=0x7f5368005df0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370006120 msgr2=0x7f5370016450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 --2- 10.20.193.28:0/2893147448 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5370006120 0x7f5370016450 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f536c009cd0 tx=0x7f536c031830 comp rx=0 tx=0).stop 2026-02-13T01:25:50.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f53777fe6c0 1 -- 10.20.193.28:0/2893147448 reap_dead start 2026-02-13T01:25:50.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 shutdown_connections 2026-02-13T01:25:50.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 >> 10.20.193.28:0/2893147448 conn(0x7f537001c5c0 msgr2=0x7f537000d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 shutdown_connections 2026-02-13T01:25:50.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.607+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa200052a50 con 0x7fa2001160d0 2026-02-13T01:25:50.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.608+0000 7f5377fff6c0 1 -- 10.20.193.28:0/2893147448 wait complete. 2026-02-13T01:25:50.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.609+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fa1f00048a0 con 0x7fa2001160d0 2026-02-13T01:25:50.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.611+0000 7fa1fcff96c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa1d40b5710 0x7fa1d40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.612+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8052+0+0 (secure 0 0 0) 0x7fa1f00e3d70 con 0x7fa2001160d0 2026-02-13T01:25:50.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.612+0000 7fa1ff7fe6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa1d40b5710 0x7fa1d40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.612+0000 7fa1fcff96c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] conn(0x7fa1d40dd150 0x7fa1d40fd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.612+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 --> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1d40fdcb0 con 0x7fa1d40dd150 2026-02-13T01:25:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.612+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa1f00e6400 con 0x7fa2001160d0 2026-02-13T01:25:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.613+0000 7fa1fffff6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] conn(0x7fa1d40dd150 0x7fa1d40fd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:50.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.613+0000 7fa1fffff6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] conn(0x7fa1d40dd150 0x7fa1d40fd5e0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.613+0000 7fa1ff7fe6c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa1d40b5710 0x7fa1d40d5bc0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f40024b0 tx=0x7fa1f4006d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:50.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.612+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== osd.0 v2:10.20.193.28:6802/2961143377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fde7c17ea60 con 0x7fde7c04ca20 2026-02-13T01:25:50.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.615+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== osd.6 v2:10.20.193.28:6818/2743891845 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa1d40fdcb0 con 0x7fa1d40dd150 2026-02-13T01:25:50.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.641+0000 7fde837416c0 1 -- 10.20.193.28:0/2445852918 --> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde7c114fe0 con 0x7fde7c04ca20 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1388778416' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2026-02-13T01:25:50.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]} : dispatch 2026-02-13T01:25:50.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]} : dispatch 2026-02-13T01:25:50.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T01:25:50.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]} : dispatch 2026-02-13T01:25:50.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.646+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 --> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa200183ac0 con 0x7fa1d40dd150 2026-02-13T01:25:50.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.647+0000 7fde6a7fc6c0 1 -- 10.20.193.28:0/2445852918 <== osd.0 v2:10.20.193.28:6802/2961143377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fde7c114fe0 con 0x7fde7c04ca20 2026-02-13T01:25:50.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.648+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] conn(0x7fde7c04ca20 msgr2=0x7fde7c04cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.648+0000 7fde4bfff6c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6802/2961143377,v1:10.20.193.28:6803/2961143377] conn(0x7fde7c04ca20 0x7fde7c04cdf0 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fde580b5790 msgr2=0x7fde580d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde4bfff6c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fde580b5790 0x7fde580d5c40 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde7c1290f0 tx=0x7fde70009690 comp rx=0 tx=0).stop 2026-02-13T01:25:50.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 msgr2=0x7fde7c122760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde4bfff6c0 1 --2- 10.20.193.28:0/2445852918 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fde7c114000 0x7fde7c122760 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde78031cb0 tx=0x7fde78031ce0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde81cb36c0 1 -- 10.20.193.28:0/2445852918 reap_dead start 2026-02-13T01:25:50.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 shutdown_connections 2026-02-13T01:25:50.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.650+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 >> 10.20.193.28:0/2445852918 conn(0x7fde7c0586e0 msgr2=0x7fde7c119550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.651+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 shutdown_connections 2026-02-13T01:25:50.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.651+0000 7fde4bfff6c0 1 -- 10.20.193.28:0/2445852918 wait complete. 2026-02-13T01:25:50.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.658+0000 7fa1fcff96c0 1 -- 10.20.193.28:0/2732147576 <== osd.6 v2:10.20.193.28:6818/2743891845 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa200183ac0 con 0x7fa1d40dd150 2026-02-13T01:25:50.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.658+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] conn(0x7fa1d40dd150 msgr2=0x7fa1d40fd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.658+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6818/2743891845,v1:10.20.193.28:6819/2743891845] conn(0x7fa1d40dd150 0x7fa1d40fd5e0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:50.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa1d40b5710 msgr2=0x7fa1d40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa1d40b5710 0x7fa1d40d5bc0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f40024b0 tx=0x7fa1f4006d50 comp rx=0 tx=0).stop 2026-02-13T01:25:50.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001160d0 msgr2=0x7fa20015f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:50.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa204b746c0 1 --2- 10.20.193.28:0/2732147576 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa2001160d0 0x7fa20015f070 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f000ba30 tx=0x7fa1f000bf00 comp rx=0 tx=0).stop 2026-02-13T01:25:50.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa1fffff6c0 1 -- 10.20.193.28:0/2732147576 reap_dead start 2026-02-13T01:25:50.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 shutdown_connections 2026-02-13T01:25:50.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.659+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 >> 10.20.193.28:0/2732147576 conn(0x7fa200059bb0 msgr2=0x7fa200183160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:50.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.660+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 shutdown_connections 2026-02-13T01:25:50.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:50.660+0000 7fa204b746c0 1 -- 10.20.193.28:0/2732147576 wait complete. 2026-02-13T01:25:50.811 INFO:teuthology.orchestra.run.trial028.stdout:64424509464 2026-02-13T01:25:50.812 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T01:25:50.823 INFO:teuthology.orchestra.run.trial028.stdout:141733920788 2026-02-13T01:25:50.824 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T01:25:51.115 INFO:teuthology.orchestra.run.trial028.stdout:94489280534 2026-02-13T01:25:51.116 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T01:25:51.124 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.124 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.145 INFO:teuthology.orchestra.run.trial028.stdout:124554051604 2026-02-13T01:25:51.145 INFO:teuthology.orchestra.run.trial028.stdout:253403070476 2026-02-13T01:25:51.146 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T01:25:51.147 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T01:25:51.160 INFO:teuthology.orchestra.run.trial028.stdout:300647710729 2026-02-13T01:25:51.161 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T01:25:51.162 INFO:teuthology.orchestra.run.trial028.stdout:47244640283 2026-02-13T01:25:51.163 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T01:25:51.166 INFO:teuthology.orchestra.run.trial028.stdout:270582939658 2026-02-13T01:25:51.167 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T01:25:51.172 INFO:teuthology.orchestra.run.trial028.stdout:193273528335 2026-02-13T01:25:51.172 INFO:teuthology.orchestra.run.trial028.stdout:223338299407 2026-02-13T01:25:51.173 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T01:25:51.174 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T01:25:51.176 INFO:teuthology.orchestra.run.trial028.stdout:176093659153 2026-02-13T01:25:51.177 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T01:25:51.200 INFO:teuthology.orchestra.run.trial028.stdout:30064771099 2026-02-13T01:25:51.200 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T01:25:51.386 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.418+0000 7f06792db6c0 1 -- 10.20.193.28:0/3153317559 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674063850 msgr2=0x7f0674061bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.418+0000 7f06792db6c0 1 --2- 10.20.193.28:0/3153317559 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674063850 0x7f0674061bd0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=16698729289233919901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0668009970 tx=0x7f066802ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T01:25:51.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2026-02-13T01:25:51.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:25:51.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:51 trial028 ceph-mon[22984]: pgmap v204: 97 pgs: 10 peering, 87 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 8.6 KiB/s wr, 18 op/s 2026-02-13T01:25:51.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 -- 10.20.193.28:0/3153317559 shutdown_connections 2026-02-13T01:25:51.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 --2- 10.20.193.28:0/3153317559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062360 0x7f0674064f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 --2- 10.20.193.28:0/3153317559 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674063850 0x7f0674061bd0 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=16698729289233919901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 --2- 10.20.193.28:0/3153317559 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0674062e60 0x7f0674063230 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 -- 10.20.193.28:0/3153317559 >> 10.20.193.28:0/3153317559 conn(0x7f067405aaa0 msgr2=0x7f067405b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 -- 10.20.193.28:0/3153317559 shutdown_connections 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.428+0000 7f06792db6c0 1 -- 10.20.193.28:0/3153317559 wait complete. 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 Processor -- start 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 -- start start 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674062360 0x7f0674105780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062e60 0x7f0674105cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 0x7f067410b520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f067410ba60 con 0x7f0674062e60 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f067410bbd0 con 0x7f0674062360 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.429+0000 7f06792db6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f067410bd90 con 0x7f067410b080 2026-02-13T01:25:51.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 0x7f067410b520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0673fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674062360 0x7f0674105780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 0x7f067410b520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50140/0 (socket says 10.20.193.28:50140) 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 -- 10.20.193.28:0/2376422856 learned_addr learned my addr 10.20.193.28:0/2376422856 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f06737fe6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062e60 0x7f0674105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 -- 10.20.193.28:0/2376422856 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674062360 msgr2=0x7f0674105780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674062360 0x7f0674105780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 -- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062e60 msgr2=0x7f0674105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062e60 0x7f0674105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f0678ada6c0 1 -- 10.20.193.28:0/2376422856 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0668009590 con 0x7f067410b080 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.430+0000 7f06737fe6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062e60 0x7f0674105cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:51.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.432+0000 7f0678ada6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 0x7f067410b520 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f066c006a60 tx=0x7f066c00cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.432+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f066c003c40 con 0x7f067410b080 2026-02-13T01:25:51.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.432+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0674198e00 con 0x7f067410b080 2026-02-13T01:25:51.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.432+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f066c00a070 con 0x7f067410b080 2026-02-13T01:25:51.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.432+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f066c003c40 con 0x7f067410b080 2026-02-13T01:25:51.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.432+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0674199330 con 0x7f067410b080 2026-02-13T01:25:51.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.433+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067405bde0 con 0x7f067410b080 2026-02-13T01:25:51.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.435+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f066c00dc50 con 0x7f067410b080 2026-02-13T01:25:51.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.437+0000 7f06717fa6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f064c0b5750 0x7f064c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.437+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f066c0e4840 con 0x7f067410b080 2026-02-13T01:25:51.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.437+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f066c0e4d30 con 0x7f067410b080 2026-02-13T01:25:51.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.438+0000 7f0673fff6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f064c0b5750 0x7f064c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.438+0000 7f0673fff6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f064c0b5750 0x7f064c0d5c00 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0664004770 tx=0x7f0664006d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2709243603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f941149f0 msgr2=0x7f2f94116380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2709243603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f941149f0 0x7f2f94116380 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=12432533553878850050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f7c00aa40 tx=0x7f2f7c02fe30 comp rx=0 tx=0).stop 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2709243603 shutdown_connections 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2709243603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f941149f0 0x7f2f94116380 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=12432533553878850050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2709243603 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94116b30 0x7f2f9417a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2709243603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f94114000 0x7f2f941143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.452+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2709243603 >> 10.20.193.28:0/2709243603 conn(0x7f2f940586e0 msgr2=0x7f2f94058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.453+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2709243603 shutdown_connections 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.453+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2709243603 wait complete. 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.454+0000 7f2f9a3dc6c0 1 Processor -- start 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.454+0000 7f2f9a3dc6c0 1 -- start start 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f9a3dc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 0x7f2f94121ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f9a3dc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f94116b30 0x7f2f94122000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f93fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 0x7f2f94121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f9a3dc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f941273c0 0x7f2f94127860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f93fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 0x7f2f94121ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52564/0 (socket says 10.20.193.28:52564) 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f9a3dc6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94127dd0 con 0x7f2f941273c0 2026-02-13T01:25:51.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f9a3dc6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94127f40 con 0x7f2f94114000 2026-02-13T01:25:51.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f9a3dc6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94128100 con 0x7f2f94116b30 2026-02-13T01:25:51.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.455+0000 7f2f93fff6c0 1 -- 10.20.193.28:0/2754860157 learned_addr learned my addr 10.20.193.28:0/2754860157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.456+0000 7f2f989526c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f941273c0 0x7f2f94127860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.456+0000 7f2f937fe6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f94116b30 0x7f2f94122000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f93fff6c0 1 -- 10.20.193.28:0/2754860157 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f94116b30 msgr2=0x7f2f94122000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f93fff6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f94116b30 0x7f2f94122000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f93fff6c0 1 -- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f941273c0 msgr2=0x7f2f94127860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f93fff6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f941273c0 0x7f2f94127860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f93fff6c0 1 -- 10.20.193.28:0/2754860157 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c00a660 con 0x7f2f94114000 2026-02-13T01:25:51.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f937fe6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f94116b30 0x7f2f94122000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:51.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f989526c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f941273c0 0x7f2f94127860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:51.461 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.457+0000 7f2f93fff6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 0x7f2f94121ac0 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8c009490 tx=0x7f2f8c00bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.458+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f8c004a80 con 0x7f2f94114000 2026-02-13T01:25:51.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.458+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f8c009030 con 0x7f2f94114000 2026-02-13T01:25:51.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.458+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f8c00ce10 con 0x7f2f94114000 2026-02-13T01:25:51.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.458+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9417cad0 con 0x7f2f94114000 2026-02-13T01:25:51.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.458+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9417cf60 con 0x7f2f94114000 2026-02-13T01:25:51.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.459+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f94114fe0 con 0x7f2f94114000 2026-02-13T01:25:51.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.461+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f2f8c004060 con 0x7f2f94114000 2026-02-13T01:25:51.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.463+0000 7f2f917fa6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2f640b57e0 0x7f2f640d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.463+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f2f8c0e3b60 con 0x7f2f94114000 2026-02-13T01:25:51.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.463+0000 7f2f937fe6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2f640b57e0 0x7f2f640d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.463+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2f8c11c5e0 con 0x7f2f94114000 2026-02-13T01:25:51.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.464+0000 7f2f937fe6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2f640b57e0 0x7f2f640d5c90 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f94128450 tx=0x7f2f7c006bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.489 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.490 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.514 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.532 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.550 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:25:51.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:51 trial134 ceph-mon[27948]: pgmap v204: 97 pgs: 10 peering, 87 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 8.6 KiB/s wr, 18 op/s 2026-02-13T01:25:51.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.574+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2f941143d0 con 0x7f2f94114000 2026-02-13T01:25:51.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.575+0000 7f2f917fa6c0 1 -- 10.20.193.28:0/2754860157 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f8c0a6460 con 0x7f2f94114000 2026-02-13T01:25:51.578 INFO:teuthology.orchestra.run.trial028.stdout:64424509464 2026-02-13T01:25:51.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.577+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2f640b57e0 msgr2=0x7f2f640d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.577+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2f640b57e0 0x7f2f640d5c90 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f94128450 tx=0x7f2f7c006bc0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.577+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 msgr2=0x7f2f94121ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.577+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 0x7f2f94121ac0 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f8c009490 tx=0x7f2f8c00bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.579 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 shutdown_connections 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2f640b57e0 0x7f2f640d5c90 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2f94116b30 0x7f2f94122000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2f941273c0 0x7f2f94127860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 --2- 10.20.193.28:0/2754860157 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2f94114000 0x7f2f94121ac0 unknown :-1 s=CLOSED pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 >> 10.20.193.28:0/2754860157 conn(0x7f2f940586e0 msgr2=0x7f2f94058ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 shutdown_connections 2026-02-13T01:25:51.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.579+0000 7f2f9a3dc6c0 1 -- 10.20.193.28:0/2754860157 wait complete. 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.577+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f06741068d0 con 0x7f067410b080 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.578+0000 7f06717fa6c0 1 -- 10.20.193.28:0/2376422856 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f066c0a7180 con 0x7f067410b080 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.581+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f064c0b5750 msgr2=0x7f064c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stdout:141733920788 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.581+0000 7f06792db6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f064c0b5750 0x7f064c0d5c00 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0664004770 tx=0x7f0664006d50 comp rx=0 tx=0).stop 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.581+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 msgr2=0x7f067410b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.581+0000 7f06792db6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 0x7f067410b520 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f066c006a60 tx=0x7f066c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 shutdown_connections 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f064c0b5750 0x7f064c0d5c00 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f067410b080 0x7f067410b520 unknown :-1 s=CLOSED pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0674062e60 0x7f0674105cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 --2- 10.20.193.28:0/2376422856 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0674062360 0x7f0674105780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 >> 10.20.193.28:0/2376422856 conn(0x7f067405aaa0 msgr2=0x7f067405f640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 shutdown_connections 2026-02-13T01:25:51.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.582+0000 7f06792db6c0 1 -- 10.20.193.28:0/2376422856 wait complete. 2026-02-13T01:25:51.585 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.600 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 7]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:25:51.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:51 trial187 ceph-mon[27464]: pgmap v204: 97 pgs: 10 peering, 87 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 8.6 KiB/s wr, 18 op/s 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/3017311227 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c810fa50 msgr2=0x7fd0c8114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/3017311227 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c810fa50 0x7fd0c8114a90 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=2417413001131716640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b80099a0 tx=0x7fd0b802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/3017311227 shutdown_connections 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/3017311227 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c810fa50 0x7fd0c8114a90 unknown :-1 s=CLOSED pgs=89 gs=2 cs=0 l=1 c_cookie=2417413001131716640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/3017311227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 0x7fd0c8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/3017311227 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/3017311227 >> 10.20.193.28:0/3017311227 conn(0x7fd0c80ec980 msgr2=0x7fd0c810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/3017311227 shutdown_connections 2026-02-13T01:25:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.702+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/3017311227 wait complete. 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 Processor -- start 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 -- start start 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c80f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 0x7fd0c8175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c80f4ff0 0x7fd0c80fa2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80f56e0 con 0x7fd0c8115270 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80fa800 con 0x7fd0c810f060 2026-02-13T01:25:51.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0cd5236c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80fa9c0 con 0x7fd0c80f4ff0 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c80f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c80f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52586/0 (socket says 10.20.193.28:52586) 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 -- 10.20.193.28:0/1659494146 learned_addr learned my addr 10.20.193.28:0/1659494146 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c77fe6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 0x7fd0c8175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0ccd226c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c80f4ff0 0x7fd0c80fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 -- 10.20.193.28:0/1659494146 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c80f4ff0 msgr2=0x7fd0c80fa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c80f4ff0 0x7fd0c80fa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 -- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 msgr2=0x7fd0c8175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 0x7fd0c8175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.703+0000 7fd0c7fff6c0 1 -- 10.20.193.28:0/1659494146 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc00a5b0 con 0x7fd0c810f060 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0ccd226c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c80f4ff0 0x7fd0c80fa2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0c77fe6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 0x7fd0c8175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0c7fff6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c80f49c0 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b400b7b0 tx=0x7fd0b400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0b4004a80 con 0x7fd0c810f060 2026-02-13T01:25:51.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b8009590 con 0x7fd0c810f060 2026-02-13T01:25:51.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c80faff0 con 0x7fd0c810f060 2026-02-13T01:25:51.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0b4009030 con 0x7fd0c810f060 2026-02-13T01:25:51.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.704+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0b40056f0 con 0x7fd0c810f060 2026-02-13T01:25:51.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.705+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c8110330 con 0x7fd0c810f060 2026-02-13T01:25:51.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.706+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fd0b400c740 con 0x7fd0c810f060 2026-02-13T01:25:51.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.708+0000 7fd0c57fa6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd0980b5710 0x7fd0980d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.708+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fd0b40e3c90 con 0x7fd0c810f060 2026-02-13T01:25:51.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.708+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0b40e4110 con 0x7fd0c810f060 2026-02-13T01:25:51.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.709+0000 7fd0c77fe6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd0980b5710 0x7fd0980d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.711+0000 7fd0c77fe6c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd0980b5710 0x7fd0980d5bc0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b80023e0 tx=0x7fd0b8031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920788 got 141733920788 for osd.5 2026-02-13T01:25:51.777 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:51.780 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509464 got 64424509464 for osd.2 2026-02-13T01:25:51.780 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:51.822 INFO:teuthology.orchestra.run.trial028.stdout:94489280534 2026-02-13T01:25:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.821+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd0c810f430 con 0x7fd0c810f060 2026-02-13T01:25:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.821+0000 7fd0c57fa6c0 1 -- 10.20.193.28:0/1659494146 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0b40a6590 con 0x7fd0c810f060 2026-02-13T01:25:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.825+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd0980b5710 msgr2=0x7fd0980d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.825+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd0980b5710 0x7fd0980d5bc0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b80023e0 tx=0x7fd0b8031f90 comp rx=0 tx=0).stop 2026-02-13T01:25:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.825+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 msgr2=0x7fd0c80f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.825+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c80f49c0 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b400b7b0 tx=0x7fd0b400bc80 comp rx=0 tx=0).stop 2026-02-13T01:25:51.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.828+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 shutdown_connections 2026-02-13T01:25:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.828+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd0980b5710 0x7fd0980d5bc0 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.828+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd0c80f4ff0 0x7fd0c80fa2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.828+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd0c8115270 0x7fd0c8175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.828+0000 7fd0cd5236c0 1 --2- 10.20.193.28:0/1659494146 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd0c810f060 0x7fd0c80f49c0 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.828+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 >> 10.20.193.28:0/1659494146 conn(0x7fd0c80ec980 msgr2=0x7fd0c810d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.829+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 shutdown_connections 2026-02-13T01:25:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.829+0000 7fd0cd5236c0 1 -- 10.20.193.28:0/1659494146 wait complete. 2026-02-13T01:25:51.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.864+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/3266993321 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10fa50 msgr2=0x7f9ecc114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.864+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/3266993321 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10fa50 0x7f9ecc114a90 secure :-1 s=READY pgs=90 gs=2 cs=0 l=1 c_cookie=14923981439857238540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9eb40098d0 tx=0x7f9eb402ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:51.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/3266993321 shutdown_connections 2026-02-13T01:25:51.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/3266993321 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10fa50 0x7f9ecc114a90 unknown :-1 s=CLOSED pgs=90 gs=2 cs=0 l=1 c_cookie=14923981439857238540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/3266993321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc115270 0x7f9ecc175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/3266993321 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc10f060 0x7f9ecc10f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/3266993321 >> 10.20.193.28:0/3266993321 conn(0x7f9ecc0ec980 msgr2=0x7f9ecc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/3266993321 shutdown_connections 2026-02-13T01:25:51.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.866+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/3266993321 wait complete. 2026-02-13T01:25:51.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.867+0000 7f9ecbfff6c0 1 Processor -- start 2026-02-13T01:25:51.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.867+0000 7f9ecbfff6c0 1 -- start start 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecbfff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10f060 0x7f9ecc17fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecbfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 0x7f9ecc17d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecbfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 0x7f9ecc17daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecbfff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc180610 con 0x7f9ecc17d650 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecbfff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc158b30 con 0x7f9ecc115270 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecbfff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc158cf0 con 0x7f9ecc10f060 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecaffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10f060 0x7f9ecc17fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 0x7f9ecc17daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9eca7fc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 0x7f9ecc17d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9eca7fc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 0x7f9ecc17d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52594/0 (socket says 10.20.193.28:52594) 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9ecb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 0x7f9ecc17daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56882/0 (socket says 10.20.193.28:56882) 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.868+0000 7f9eca7fc6c0 1 -- 10.20.193.28:0/1361481792 learned_addr learned my addr 10.20.193.28:0/1361481792 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eca7fc6c0 1 -- 10.20.193.28:0/1361481792 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10f060 msgr2=0x7f9ecc17fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eca7fc6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10f060 0x7f9ecc17fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eca7fc6c0 1 -- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 msgr2=0x7f9ecc17daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eca7fc6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 0x7f9ecc17daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eca7fc6c0 1 -- 10.20.193.28:0/1361481792 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb40094c0 con 0x7f9ecc115270 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9ecb7fe6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 0x7f9ecc17daf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eca7fc6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 0x7f9ecc17d110 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9eb4009a00 tx=0x7f9eb40028e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9eb402f8a0 con 0x7f9ecc115270 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9eb40045f0 con 0x7f9ecc115270 2026-02-13T01:25:51.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.869+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9eb4007420 con 0x7f9ecc115270 2026-02-13T01:25:51.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.870+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc158f70 con 0x7f9ecc115270 2026-02-13T01:25:51.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.870+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc1593a0 con 0x7f9ecc115270 2026-02-13T01:25:51.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.871+0000 7f9ea9ffb6c0 1 -- 10.20.193.28:0/1361481792 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e94005310 con 0x7f9ecc115270 2026-02-13T01:25:51.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.872+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f9eb4002ad0 con 0x7f9ecc115270 2026-02-13T01:25:51.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.874+0000 7f9eabfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ea00b5710 0x7f9ea00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.875+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f9eb4107f90 con 0x7f9ecc115270 2026-02-13T01:25:51.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.875+0000 7f9ecaffd6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ea00b5710 0x7f9ea00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.875+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9eb4108410 con 0x7f9ecc115270 2026-02-13T01:25:51.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.875+0000 7f9ecaffd6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ea00b5710 0x7f9ea00d5bc0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec0005fd0 tx=0x7f9ec00093f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.907+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/84802169 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a405a4c0 msgr2=0x7f90a417a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.907+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/84802169 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a405a4c0 0x7f90a417a780 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=11850073500017350784 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f909c006fd0 tx=0x7f909c02fd40 comp rx=0 tx=0).stop 2026-02-13T01:25:51.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/84802169 shutdown_connections 2026-02-13T01:25:51.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/84802169 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a405a4c0 0x7f90a417a780 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=11850073500017350784 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/84802169 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a41149f0 0x7f90a4116380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/84802169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90a4114000 0x7f90a41143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/84802169 >> 10.20.193.28:0/84802169 conn(0x7f90a40586e0 msgr2=0x7f90a4058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/84802169 shutdown_connections 2026-02-13T01:25:51.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.908+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/84802169 wait complete. 2026-02-13T01:25:51.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.909+0000 7f90aa5c06c0 1 Processor -- start 2026-02-13T01:25:51.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.910+0000 7f90aa5c06c0 1 -- start start 2026-02-13T01:25:51.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90aa5c06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 0x7f90a4121ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90aa5c06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90a4114000 0x7f90a4122010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90a3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 0x7f90a4121ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90a3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 0x7f90a4121ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52608/0 (socket says 10.20.193.28:52608) 2026-02-13T01:25:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90aa5c06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a41273d0 0x7f90a4127870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90aa5c06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4127de0 con 0x7f90a4114000 2026-02-13T01:25:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90aa5c06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4127f50 con 0x7f90a405a4c0 2026-02-13T01:25:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.911+0000 7f90aa5c06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4128110 con 0x7f90a41273d0 2026-02-13T01:25:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a8b326c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a41273d0 0x7f90a4127870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a3fff6c0 1 -- 10.20.193.28:0/1657691291 learned_addr learned my addr 10.20.193.28:0/1657691291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a8b326c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a41273d0 0x7f90a4127870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50224/0 (socket says 10.20.193.28:50224) 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a37fe6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90a4114000 0x7f90a4122010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a3fff6c0 1 -- 10.20.193.28:0/1657691291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a41273d0 msgr2=0x7f90a4127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a3fff6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a41273d0 0x7f90a4127870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a3fff6c0 1 -- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90a4114000 msgr2=0x7f90a4122010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a3fff6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90a4114000 0x7f90a4122010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.912+0000 7f90a3fff6c0 1 -- 10.20.193.28:0/1657691291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9098009590 con 0x7f90a405a4c0 2026-02-13T01:25:51.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.914+0000 7f90a3fff6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 0x7f90a4121ad0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9098004750 tx=0x7f909800be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.914+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9098004250 con 0x7f90a405a4c0 2026-02-13T01:25:51.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.914+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9098009070 con 0x7f90a405a4c0 2026-02-13T01:25:51.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.914+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90980071c0 con 0x7f90a405a4c0 2026-02-13T01:25:51.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.915+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c00a5b0 con 0x7f90a405a4c0 2026-02-13T01:25:51.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.916+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a41688c0 con 0x7f90a405a4c0 2026-02-13T01:25:51.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.916+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a4114fe0 con 0x7f90a405a4c0 2026-02-13T01:25:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.933+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f90980028c0 con 0x7f90a405a4c0 2026-02-13T01:25:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.935+0000 7f90a17fa6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f90700b5860 0x7f90700d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.935+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f90980e3df0 con 0x7f90a405a4c0 2026-02-13T01:25:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.935+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90980e41f0 con 0x7f90a405a4c0 2026-02-13T01:25:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.936+0000 7f90a37fe6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f90700b5860 0x7f90700d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.936+0000 7f90a37fe6c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f90700b5860 0x7f90700d5d10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90a4128460 tx=0x7f908c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.965+0000 7f92f35776c0 1 -- 10.20.193.28:0/1526368557 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f405e540 msgr2=0x7f92f417a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.965+0000 7f92f35776c0 1 --2- 10.20.193.28:0/1526368557 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f405e540 0x7f92f417a5c0 secure :-1 s=READY pgs=95 gs=3 cs=0 l=1 c_cookie=18311987262773057793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e00098a0 tx=0x7f92e002ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:51.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.966+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/226229003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c11b3f0 msgr2=0x7ff85c11b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.966+0000 7ff861dcb6c0 1 --2- 10.20.193.28:0/226229003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c11b3f0 0x7ff85c11b7c0 secure :-1 s=READY pgs=211 gs=2 cs=0 l=1 c_cookie=15933002910364961882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85400aa40 tx=0x7ff85402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 -- 10.20.193.28:0/1526368557 shutdown_connections 2026-02-13T01:25:51.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 --2- 10.20.193.28:0/1526368557 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f41149f0 0x7f92f41161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 --2- 10.20.193.28:0/1526368557 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f405e540 0x7f92f417a5c0 unknown :-1 s=CLOSED pgs=95 gs=3 cs=0 l=1 c_cookie=18311987262773057793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 --2- 10.20.193.28:0/1526368557 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92f4114000 0x7f92f41143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 -- 10.20.193.28:0/1526368557 >> 10.20.193.28:0/1526368557 conn(0x7f92f405aaa0 msgr2=0x7f92f405b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 -- 10.20.193.28:0/1526368557 shutdown_connections 2026-02-13T01:25:51.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7f92f35776c0 1 -- 10.20.193.28:0/1526368557 wait complete. 2026-02-13T01:25:51.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/226229003 shutdown_connections 2026-02-13T01:25:51.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7ff861dcb6c0 1 --2- 10.20.193.28:0/226229003 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff85c118f30 0x7ff85c119380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7ff861dcb6c0 1 --2- 10.20.193.28:0/226229003 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c1199a0 0x7ff85c116df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7ff861dcb6c0 1 --2- 10.20.193.28:0/226229003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c11b3f0 0x7ff85c11b7c0 unknown :-1 s=CLOSED pgs=211 gs=2 cs=0 l=1 c_cookie=15933002910364961882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/226229003 >> 10.20.193.28:0/226229003 conn(0x7ff85c05aaa0 msgr2=0x7ff85c05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.967+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/226229003 shutdown_connections 2026-02-13T01:25:51.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7f92f35776c0 1 Processor -- start 2026-02-13T01:25:51.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7f92f35776c0 1 -- start start 2026-02-13T01:25:51.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7f92f35776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 0x7f92f417d900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7f92f35776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f4114000 0x7f92f417be70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7f92f35776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92f417c3b0 0x7f92f417c850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7f92f35776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92f416e580 con 0x7f92f417c3b0 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7f92f35776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4125b50 con 0x7f92f4114000 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7f92f25756c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 0x7f92f417d900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7f92f25756c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 0x7f92f417d900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50258/0 (socket says 10.20.193.28:50258) 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7f92f25756c0 1 -- 10.20.193.28:0/3842153832 learned_addr learned my addr 10.20.193.28:0/3842153832 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4125d10 con 0x7f92f405e540 2026-02-13T01:25:51.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7f92f1d746c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f4114000 0x7f92f417be70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7f92f1d746c0 1 -- 10.20.193.28:0/3842153832 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 msgr2=0x7f92f417d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7f92f1d746c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 0x7f92f417d900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7f92f1d746c0 1 -- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92f417c3b0 msgr2=0x7f92f417c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.968+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/226229003 wait complete. 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.968+0000 7ff861dcb6c0 1 Processor -- start 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.968+0000 7ff861dcb6c0 1 -- start start 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7ff861dcb6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c118f30 0x7ff85c0fdcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7ff861dcb6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff85c1199a0 0x7ff85c0fe230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.969+0000 7ff861dcb6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 0x7ff85c1035f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff861dcb6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c103bf0 con 0x7ff85c118f30 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff861dcb6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c103d60 con 0x7ff85c11b3f0 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 0x7ff85c1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 0x7ff85c1035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52648/0 (socket says 10.20.193.28:52648) 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 -- 10.20.193.28:0/731117550 learned_addr learned my addr 10.20.193.28:0/731117550 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/731117550 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c103f20 con 0x7ff85c1199a0 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 -- 10.20.193.28:0/731117550 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff85c1199a0 msgr2=0x7ff85c0fe230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff85bfff6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff85c1199a0 0x7ff85c0fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff85c1199a0 0x7ff85c0fe230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 -- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c118f30 msgr2=0x7ff85c0fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff860dc96c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c118f30 0x7ff85c0fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c118f30 0x7ff85c0fdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff8615ca6c0 1 -- 10.20.193.28:0/731117550 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85400a660 con 0x7ff85c11b3f0 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.970+0000 7ff860dc96c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c118f30 0x7ff85c0fdcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7ff8615ca6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 0x7ff85c1035f0 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff850005dc0 tx=0x7ff85000bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff850004250 con 0x7ff85c11b3f0 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/731117550 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85c104200 con 0x7ff85c11b3f0 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7ff861dcb6c0 1 -- 10.20.193.28:0/731117550 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85c104910 con 0x7ff85c11b3f0 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff850009070 con 0x7ff85c11b3f0 2026-02-13T01:25:51.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff85000cdc0 con 0x7ff85c11b3f0 2026-02-13T01:25:51.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7f92f1d746c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92f417c3b0 0x7f92f417c850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7f92f1d746c0 1 -- 10.20.193.28:0/3842153832 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e400a660 con 0x7f92f4114000 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.971+0000 7f92f25756c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 0x7f92f417d900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.972+0000 7f92f1d746c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f4114000 0x7f92f417be70 secure :-1 s=READY pgs=97 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92f405c300 tx=0x7f92dc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.973+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92dc0044a0 con 0x7f92f4114000 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.973+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f92dc009030 con 0x7f92f4114000 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.973+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92dc0071c0 con 0x7f92f4114000 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.973+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc0094c0 con 0x7f92f4114000 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.973+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e00094c0 con 0x7f92f4114000 2026-02-13T01:25:51.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.974+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f41143d0 con 0x7f92f4114000 2026-02-13T01:25:51.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.975+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff8500028c0 con 0x7ff85c11b3f0 2026-02-13T01:25:51.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.977+0000 7ff859ffb6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8380b5710 0x7ff8380d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.977+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7ff8500e3c30 con 0x7ff85c11b3f0 2026-02-13T01:25:51.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.977+0000 7ff860dc96c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8380b5710 0x7ff8380d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.975+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/4141885790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 msgr2=0x7f78940b7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.975+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/4141885790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78940b7280 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=2736528370838887501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7888009b30 tx=0x7f788802eea0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/4141885790 shutdown_connections 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/4141885790 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78940bd0c0 0x7f789411da60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/4141885790 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940b78a0 0x7f78940bc8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/4141885790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78940b7280 unknown :-1 s=CLOSED pgs=212 gs=2 cs=0 l=1 c_cookie=2736528370838887501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/4141885790 >> 10.20.193.28:0/4141885790 conn(0x7f7894094790 msgr2=0x7f78940b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/4141885790 shutdown_connections 2026-02-13T01:25:51.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.978+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/4141885790 wait complete. 2026-02-13T01:25:51.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.979+0000 7f78a2fd46c0 1 Processor -- start 2026-02-13T01:25:51.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.979+0000 7ff860dc96c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8380b5710 0x7ff8380d5bc0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85400a990 tx=0x7ff854002470 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.979+0000 7f78a2fd46c0 1 -- start start 2026-02-13T01:25:51.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.979+0000 7f78a2fd46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78941258b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a2fd46c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940bd0c0 0x7f789411d960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a2fd46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 0x7f78940a7f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a2fd46c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7894126560 con 0x7f78940b6eb0 2026-02-13T01:25:51.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a2fd46c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78940a84d0 con 0x7f78940bd0c0 2026-02-13T01:25:51.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a2fd46c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f78940a8690 con 0x7f7894125e90 2026-02-13T01:25:51.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f789bfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940bd0c0 0x7f789411d960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a0d496c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78941258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.980+0000 7f78a154a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 0x7f78940a7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.982+0000 7f78a154a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 0x7f78940a7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50268/0 (socket says 10.20.193.28:50268) 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.982+0000 7f78a0d496c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78941258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56952/0 (socket says 10.20.193.28:56952) 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.982+0000 7f78a0d496c0 1 -- 10.20.193.28:0/3824058210 learned_addr learned my addr 10.20.193.28:0/3824058210 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.982+0000 7f789bfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940bd0c0 0x7f789411d960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52678/0 (socket says 10.20.193.28:52678) 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a154a6c0 1 -- 10.20.193.28:0/3824058210 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940bd0c0 msgr2=0x7f789411d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a154a6c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940bd0c0 0x7f789411d960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a154a6c0 1 -- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 msgr2=0x7f78941258b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a154a6c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78941258b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a154a6c0 1 -- 10.20.193.28:0/3824058210 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c0094c0 con 0x7f7894125e90 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a0d496c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78941258b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:51.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f78a154a6c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 0x7f78940a7f90 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7890006f60 tx=0x7f789000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.983+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7890003c40 con 0x7f7894125e90 2026-02-13T01:25:51.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.984+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7890003da0 con 0x7f7894125e90 2026-02-13T01:25:51.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.984+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f789000de30 con 0x7f7894125e90 2026-02-13T01:25:51.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.984+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78880094c0 con 0x7f7894125e90 2026-02-13T01:25:51.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.984+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78940a8c70 con 0x7f7894125e90 2026-02-13T01:25:51.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.985+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85c05bd90 con 0x7ff85c11b3f0 2026-02-13T01:25:51.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.985+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7864005310 con 0x7f7894125e90 2026-02-13T01:25:51.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/930025922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0c4170 msgr2=0x7fbcac0c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/930025922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0c4170 0x7fbcac0c4540 secure :-1 s=READY pgs=213 gs=2 cs=0 l=1 c_cookie=15654985976977235774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca00098a0 tx=0x7fbca002ec50 comp rx=0 tx=0).stop 2026-02-13T01:25:51.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/930025922 shutdown_connections 2026-02-13T01:25:51.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/930025922 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0ca560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/930025922 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4a80 0x7fbcac0c9ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/930025922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0c4170 0x7fbcac0c4540 unknown :-1 s=CLOSED pgs=213 gs=2 cs=0 l=1 c_cookie=15654985976977235774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.986+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/930025922 >> 10.20.193.28:0/930025922 conn(0x7fbcac01c590 msgr2=0x7fbcac01cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:51.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.987+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/930025922 shutdown_connections 2026-02-13T01:25:51.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.987+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/930025922 wait complete. 2026-02-13T01:25:51.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.987+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8500a6530 con 0x7ff85c11b3f0 2026-02-13T01:25:51.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.987+0000 7fbcb93ce6c0 1 Processor -- start 2026-02-13T01:25:51.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.988+0000 7fbcb93ce6c0 1 -- start start 2026-02-13T01:25:51.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.988+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f92dc03c630 con 0x7f92f4114000 2026-02-13T01:25:51.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.988+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f7890005030 con 0x7f7894125e90 2026-02-13T01:25:51.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.988+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/4134294601 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258116720 msgr2=0x7ff258116bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.988+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/4134294601 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258116720 0x7ff258116bc0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=7827721551256839986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25400aa70 tx=0x7ff25402fe00 comp rx=0 tx=0).stop 2026-02-13T01:25:51.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.988+0000 7fbcb93ce6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 0x7fbcac0aad50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.989+0000 7fbcb93ce6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcac0c4a80 0x7fbcac0ab290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.989+0000 7fbcb93ce6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0b0650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.989+0000 7fbcb3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 0x7fbcac0aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.989+0000 7fbcb3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 0x7fbcac0aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52700/0 (socket says 10.20.193.28:52700) 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56962/0 (socket says 10.20.193.28:56962) 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb93ce6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0b0c50 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb93ce6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0b0dc0 con 0x7fbcac0c4170 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb93ce6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0b0f80 con 0x7fbcac0c4a80 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb37fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcac0c4a80 0x7fbcac0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb3fff6c0 1 -- 10.20.193.28:0/232922549 learned_addr learned my addr 10.20.193.28:0/232922549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 -- 10.20.193.28:0/232922549 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcac0c4a80 msgr2=0x7fbcac0ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcac0c4a80 0x7fbcac0ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 -- 10.20.193.28:0/232922549 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 msgr2=0x7fbcac0aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:51.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 0x7fbcac0aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:51.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 -- 10.20.193.28:0/232922549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca800a660 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb8bcd6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0b0650 secure :-1 s=READY pgs=214 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca8006c20 tx=0x7fbca800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.990+0000 7fbcb3fff6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 0x7fbcac0aad50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2026-02-13T01:25:51.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.991+0000 7f7899ffb6c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f787c0b5790 0x7f787c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.992+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f78900e4b10 con 0x7f7894125e90 2026-02-13T01:25:51.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.991+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbca800dac0 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.991+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbca800a070 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.991+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbca80081c0 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.991+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca00094c0 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.992+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac10df60 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.992+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f78900e8120 con 0x7f7894125e90 2026-02-13T01:25:51.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.992+0000 7f78a0d496c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f787c0b5790 0x7f787c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.993+0000 7f78a0d496c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f787c0b5790 0x7f787c0d5c40 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7888009a50 tx=0x7f78880023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.994+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac0c5440 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.993+0000 7f92eb7fe6c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f92d80b5860 0x7f92d80d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.993+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f92dc0e3c30 con 0x7f92f4114000 2026-02-13T01:25:51.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.993+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f92dc11c620 con 0x7f92f4114000 2026-02-13T01:25:51.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.993+0000 7f92f25756c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f92d80b5860 0x7f92d80d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.994+0000 7f92f25756c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f92d80b5860 0x7f92d80d5d10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e4005830 tx=0x7f92e4006f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:51.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.996+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fbca800dc20 con 0x7fbcac0ca0e0 2026-02-13T01:25:51.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.997+0000 7fbcb17fa6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbc880b5660 0x7fbc880d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:51.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.997+0000 7fbcb3fff6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbc880b5660 0x7fbc880d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:51.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.998+0000 7fbcb3fff6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbc880b5660 0x7fbc880d5b10 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca00099d0 tx=0x7fbca00092d0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:51.999+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fbca80e4e40 con 0x7fbcac0ca0e0 2026-02-13T01:25:52.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.000+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbca80a77c0 con 0x7fbcac0ca0e0 2026-02-13T01:25:52.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7f9ea9ffb6c0 1 -- 10.20.193.28:0/1361481792 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f9e94005890 con 0x7f9ecc115270 2026-02-13T01:25:52.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7f9eabfff6c0 1 -- 10.20.193.28:0/1361481792 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9eb40ca890 con 0x7f9ecc115270 2026-02-13T01:25:52.003 INFO:teuthology.orchestra.run.trial028.stdout:270582939658 2026-02-13T01:25:52.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/4134294601 shutdown_connections 2026-02-13T01:25:52.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/4134294601 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114910 0x7ff2581161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/4134294601 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258116720 0x7ff258116bc0 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=7827721551256839986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/4134294601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258114000 0x7ff2581143d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.002+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/4134294601 >> 10.20.193.28:0/4134294601 conn(0x7ff25805aaa0 msgr2=0x7ff25805b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ea00b5710 msgr2=0x7f9ea00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ea00b5710 0x7f9ea00d5bc0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec0005fd0 tx=0x7f9ec00093f0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 msgr2=0x7f9ecc17d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 0x7f9ecc17d110 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9eb4009a00 tx=0x7f9eb40028e0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.003+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/4134294601 shutdown_connections 2026-02-13T01:25:52.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.004+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/4134294601 wait complete. 2026-02-13T01:25:52.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.004+0000 7ff25e08f6c0 1 Processor -- start 2026-02-13T01:25:52.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7ff25e08f6c0 1 -- start start 2026-02-13T01:25:52.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.006+0000 7ff25e08f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 0x7ff25811db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.006+0000 7ff25e08f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 0x7ff25811e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.009 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280534 got 94489280534 for osd.3 2026-02-13T01:25:52.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 shutdown_connections 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ecc17d650 0x7f9ecc17daf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9ecc115270 0x7f9ecc17d110 unknown :-1 s=CLOSED pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ea00b5710 0x7f9ea00d5bc0 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 --2- 10.20.193.28:0/1361481792 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9ecc10f060 0x7f9ecc17fe50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 >> 10.20.193.28:0/1361481792 conn(0x7f9ecc0ec980 msgr2=0x7f9ecc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.005+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 shutdown_connections 2026-02-13T01:25:52.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.006+0000 7f9ecbfff6c0 1 -- 10.20.193.28:0/1361481792 wait complete. 2026-02-13T01:25:52.010 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.006+0000 7ff25e08f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258116720 0x7ff258123310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.007+0000 7ff25d08d6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 0x7ff25811db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.007+0000 7ff25d08d6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 0x7ff25811db50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50286/0 (socket says 10.20.193.28:50286) 2026-02-13T01:25:52.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.007+0000 7ff25c88c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 0x7ff25811e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.007+0000 7ff25c88c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 0x7ff25811e090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52704/0 (socket says 10.20.193.28:52704) 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d08d6c0 1 -- 10.20.193.28:0/3929056646 learned_addr learned my addr 10.20.193.28:0/3929056646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff258123960 con 0x7ff258116720 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff258123ad0 con 0x7ff258114910 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff258123c90 con 0x7ff258114000 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d88e6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258116720 0x7ff258123310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d88e6c0 1 -- 10.20.193.28:0/3929056646 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 msgr2=0x7ff25811db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d88e6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 0x7ff25811db50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d88e6c0 1 -- 10.20.193.28:0/3929056646 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 msgr2=0x7ff25811e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d88e6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 0x7ff25811e090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.008+0000 7ff25d88e6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25400a660 con 0x7ff258116720 2026-02-13T01:25:52.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.009+0000 7ff25c88c6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 0x7ff25811e090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:52.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.009+0000 7ff25d08d6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 0x7ff25811db50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:52.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.010+0000 7ff25d88e6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258116720 0x7ff258123310 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff254032fd0 tx=0x7ff254005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.010+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2540081c0 con 0x7ff258116720 2026-02-13T01:25:52.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.012+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff258123f10 con 0x7ff258116720 2026-02-13T01:25:52.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.012+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff254030d90 con 0x7ff258116720 2026-02-13T01:25:52.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.012+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2540329c0 con 0x7ff258116720 2026-02-13T01:25:52.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.013+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2581646d0 con 0x7ff258116720 2026-02-13T01:25:52.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.015+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff220005310 con 0x7ff258116720 2026-02-13T01:25:52.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.018+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff254032030 con 0x7ff258116720 2026-02-13T01:25:52.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.018+0000 7f63805686c0 1 -- 10.20.193.28:0/1293894188 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637810cf90 msgr2=0x7f637810d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.018+0000 7f63805686c0 1 --2- 10.20.193.28:0/1293894188 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637810cf90 0x7f637810d360 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=12784050607992909695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f636c0099a0 tx=0x7f636c02ed70 comp rx=0 tx=0).stop 2026-02-13T01:25:52.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.020+0000 7ff2467fc6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff2280b5710 0x7ff2280d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7ff25d08d6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff2280b5710 0x7ff2280d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7ff2540cfb60 con 0x7ff258116720 2026-02-13T01:25:52.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff2540cb7b0 con 0x7ff258116720 2026-02-13T01:25:52.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 -- 10.20.193.28:0/1293894188 shutdown_connections 2026-02-13T01:25:52.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 --2- 10.20.193.28:0/1293894188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63781131a0 0x7f6378173b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 --2- 10.20.193.28:0/1293894188 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f637810d980 0x7f63781129c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 --2- 10.20.193.28:0/1293894188 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637810cf90 0x7f637810d360 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=12784050607992909695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 -- 10.20.193.28:0/1293894188 >> 10.20.193.28:0/1293894188 conn(0x7f63780ea8b0 msgr2=0x7f637810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 -- 10.20.193.28:0/1293894188 shutdown_connections 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.019+0000 7f63805686c0 1 -- 10.20.193.28:0/1293894188 wait complete. 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7f63805686c0 1 Processor -- start 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7f63805686c0 1 -- start start 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7f63805686c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 0x7f637805e7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7f63805686c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f63781131a0 0x7f637805ca50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.021+0000 7f63805686c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637805d140 0x7f6378160480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f63805686c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f637805d830 con 0x7f637810cf90 2026-02-13T01:25:52.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f63805686c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63781609c0 con 0x7f63781131a0 2026-02-13T01:25:52.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f63805686c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6378160b80 con 0x7f637805d140 2026-02-13T01:25:52.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 0x7f637805e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 0x7f637805e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56978/0 (socket says 10.20.193.28:56978) 2026-02-13T01:25:52.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7ff25d08d6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff2280b5710 0x7ff2280d5bc0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248006ae0 tx=0x7ff248006f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 -- 10.20.193.28:0/2789173777 learned_addr learned my addr 10.20.193.28:0/2789173777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 -- 10.20.193.28:0/2789173777 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637805d140 msgr2=0x7f6378160480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637805d140 0x7f6378160480 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 -- 10.20.193.28:0/2789173777 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f63781131a0 msgr2=0x7f637805ca50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f63781131a0 0x7f637805ca50 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.022+0000 7f637e2d96c0 1 -- 10.20.193.28:0/2789173777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637400a5b0 con 0x7f637810cf90 2026-02-13T01:25:52.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7f637e2d96c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 0x7f637805e7d0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f636c005b20 tx=0x7f636c002960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f636c002d70 con 0x7f637810cf90 2026-02-13T01:25:52.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f636c005e60 con 0x7f637810cf90 2026-02-13T01:25:52.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f636c0373f0 con 0x7f637810cf90 2026-02-13T01:25:52.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c009590 con 0x7f637810cf90 2026-02-13T01:25:52.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.023+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781610a0 con 0x7f637810cf90 2026-02-13T01:25:52.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.025+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6338005310 con 0x7f637810cf90 2026-02-13T01:25:52.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.027+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f636c007260 con 0x7f637810cf90 2026-02-13T01:25:52.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.029+0000 7f63677fe6c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f63440b57e0 0x7f63440d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.030+0000 7f637dad86c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f63440b57e0 0x7f63440d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.033+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f636c0cec10 con 0x7f637810cf90 2026-02-13T01:25:52.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.033+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f636c0caa00 con 0x7f637810cf90 2026-02-13T01:25:52.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.035+0000 7f637dad86c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f63440b57e0 0x7f63440d5c90 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f637810e970 tx=0x7f6368009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.075+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f90a41149f0 con 0x7f90a405a4c0 2026-02-13T01:25:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.075+0000 7f90a17fa6c0 1 -- 10.20.193.28:0/1657691291 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f90980a66f0 con 0x7f90a405a4c0 2026-02-13T01:25:52.079 INFO:teuthology.orchestra.run.trial028.stdout:193273528335 2026-02-13T01:25:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.078+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f90700b5860 msgr2=0x7f90700d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.078+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f90700b5860 0x7f90700d5d10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90a4128460 tx=0x7f908c009260 comp rx=0 tx=0).stop 2026-02-13T01:25:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 msgr2=0x7f90a4121ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 0x7f90a4121ad0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9098004750 tx=0x7f909800be00 comp rx=0 tx=0).stop 2026-02-13T01:25:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 shutdown_connections 2026-02-13T01:25:52.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f90700b5860 0x7f90700d5d10 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f90a41273d0 0x7f90a4127870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90a4114000 0x7f90a4122010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 --2- 10.20.193.28:0/1657691291 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f90a405a4c0 0x7f90a4121ad0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 >> 10.20.193.28:0/1657691291 conn(0x7f90a40586e0 msgr2=0x7f90a41173b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 shutdown_connections 2026-02-13T01:25:52.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.079+0000 7f90aa5c06c0 1 -- 10.20.193.28:0/1657691291 wait complete. 2026-02-13T01:25:52.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.108+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f92f417f960 con 0x7f92f4114000 2026-02-13T01:25:52.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.110+0000 7f92eb7fe6c0 1 -- 10.20.193.28:0/3842153832 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f92dc0a6530 con 0x7f92f4114000 2026-02-13T01:25:52.111 INFO:teuthology.orchestra.run.trial028.stdout:300647710729 2026-02-13T01:25:52.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f92d80b5860 msgr2=0x7f92d80d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f92d80b5860 0x7f92d80d5d10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92e4005830 tx=0x7f92e4006f90 comp rx=0 tx=0).stop 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f4114000 msgr2=0x7f92f417be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f4114000 0x7f92f417be70 secure :-1 s=READY pgs=97 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92f405c300 tx=0x7f92dc00bed0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 shutdown_connections 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92f417c3b0 0x7f92f417c850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f92f4114000 0x7f92f417be70 unknown :-1 s=CLOSED pgs=97 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f92d80b5860 0x7f92d80d5d10 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 --2- 10.20.193.28:0/3842153832 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f92f405e540 0x7f92f417d900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 >> 10.20.193.28:0/3842153832 conn(0x7f92f405aaa0 msgr2=0x7f92f41151d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 shutdown_connections 2026-02-13T01:25:52.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.114+0000 7f92f35776c0 1 -- 10.20.193.28:0/3842153832 wait complete. 2026-02-13T01:25:52.118 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939658 got 270582939658 for osd.10 2026-02-13T01:25:52.119 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.121 INFO:teuthology.orchestra.run.trial028.stdout:47244640283 2026-02-13T01:25:52.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.117+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff85c0fee40 con 0x7ff85c11b3f0 2026-02-13T01:25:52.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.119+0000 7ff859ffb6c0 1 -- 10.20.193.28:0/731117550 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8500a96e0 con 0x7ff85c11b3f0 2026-02-13T01:25:52.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.121+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8380b5710 msgr2=0x7ff8380d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.121+0000 7ff8337fe6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8380b5710 0x7ff8380d5bc0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff85400a990 tx=0x7ff854002470 comp rx=0 tx=0).stop 2026-02-13T01:25:52.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.121+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 msgr2=0x7ff85c1035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.121+0000 7ff8337fe6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 0x7ff85c1035f0 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff850005dc0 tx=0x7ff85000bb60 comp rx=0 tx=0).stop 2026-02-13T01:25:52.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.122+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 shutdown_connections 2026-02-13T01:25:52.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.122+0000 7ff8337fe6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8380b5710 0x7ff8380d5bc0 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.122+0000 7ff8337fe6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff85c1199a0 0x7ff85c0fe230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.122+0000 7ff8337fe6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff85c11b3f0 0x7ff85c1035f0 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.122+0000 7ff8337fe6c0 1 --2- 10.20.193.28:0/731117550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff85c118f30 0x7ff85c0fdcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.122+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 >> 10.20.193.28:0/731117550 conn(0x7ff85c05aaa0 msgr2=0x7ff85c0f7420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.124+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 shutdown_connections 2026-02-13T01:25:52.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.124+0000 7ff8337fe6c0 1 -- 10.20.193.28:0/731117550 wait complete. 2026-02-13T01:25:52.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.130+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f78640055c0 con 0x7f7894125e90 2026-02-13T01:25:52.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.131+0000 7f7899ffb6c0 1 -- 10.20.193.28:0/3824058210 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f78900a7410 con 0x7f7894125e90 2026-02-13T01:25:52.133 INFO:teuthology.orchestra.run.trial028.stdout:253403070476 2026-02-13T01:25:52.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.132+0000 7fce854786c0 1 -- 10.20.193.28:0/3029585676 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce80115410 msgr2=0x7fce80175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.132+0000 7fce854786c0 1 --2- 10.20.193.28:0/3029585676 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce80115410 0x7fce80175db0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=16398507237668320208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce740099a0 tx=0x7fce7402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:52.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.133+0000 7fce854786c0 1 -- 10.20.193.28:0/3029585676 shutdown_connections 2026-02-13T01:25:52.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.133+0000 7fce854786c0 1 --2- 10.20.193.28:0/3029585676 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce80115410 0x7fce80175db0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=16398507237668320208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.134+0000 7fce854786c0 1 --2- 10.20.193.28:0/3029585676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce8010fbf0 0x7fce80114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.134+0000 7fce854786c0 1 --2- 10.20.193.28:0/3029585676 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce8010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.134+0000 7fce854786c0 1 -- 10.20.193.28:0/3029585676 >> 10.20.193.28:0/3029585676 conn(0x7fce800ecb00 msgr2=0x7fce8010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.134+0000 7fce854786c0 1 -- 10.20.193.28:0/3029585676 shutdown_connections 2026-02-13T01:25:52.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.134+0000 7fce854786c0 1 -- 10.20.193.28:0/3029585676 wait complete. 2026-02-13T01:25:52.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.136+0000 7fce854786c0 1 Processor -- start 2026-02-13T01:25:52.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.136+0000 7fce854786c0 1 -- start start 2026-02-13T01:25:52.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7fce854786c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce801802c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7fce854786c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce80115410 0x7fce8017d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7fce854786c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 0x7fce80158cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7fce7effd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce801802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f787c0b5790 msgr2=0x7f787c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7fce7effd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce801802c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52742/0 (socket says 10.20.193.28:52742) 2026-02-13T01:25:52.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7fce7e7fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce80115410 0x7fce8017d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.139+0000 7fce7f7fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 0x7fce80158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.139+0000 7fce7f7fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 0x7fce80158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50314/0 (socket says 10.20.193.28:50314) 2026-02-13T01:25:52.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.139+0000 7fce7f7fe6c0 1 -- 10.20.193.28:0/527335156 learned_addr learned my addr 10.20.193.28:0/527335156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:52.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f787c0b5790 0x7f787c0d5c40 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7888009a50 tx=0x7f78880023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.139+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fce8017e310 con 0x7fce80115410 2026-02-13T01:25:52.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.140+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fce80159210 con 0x7fce8010f200 2026-02-13T01:25:52.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.140+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fce801593d0 con 0x7fce8017dc20 2026-02-13T01:25:52.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 msgr2=0x7f78940a7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7effd6c0 1 -- 10.20.193.28:0/527335156 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 msgr2=0x7fce80158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7effd6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 0x7fce80158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7effd6c0 1 -- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce80115410 msgr2=0x7fce8017d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7effd6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce80115410 0x7fce8017d530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7effd6c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce74009590 con 0x7fce8010f200 2026-02-13T01:25:52.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7e7fc6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce80115410 0x7fce8017d530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:52.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7fce7f7fe6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 0x7fce80158cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:52.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.137+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 0x7f78940a7f90 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7890006f60 tx=0x7f789000cc00 comp rx=0 tx=0).stop 2026-02-13T01:25:52.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.142+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbcac0c9ba0 con 0x7fbcac0ca0e0 2026-02-13T01:25:52.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.142+0000 7fce7effd6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce801802c0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70005830 tx=0x7fce7000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.145 INFO:teuthology.orchestra.run.trial028.stdout:124554051605 2026-02-13T01:25:52.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.142+0000 7fbcb17fa6c0 1 -- 10.20.193.28:0/232922549 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbca80aa970 con 0x7fbcac0ca0e0 2026-02-13T01:25:52.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.143+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce70005280 con 0x7fce8010f200 2026-02-13T01:25:52.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.143+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce70003cf0 con 0x7fce8010f200 2026-02-13T01:25:52.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 shutdown_connections 2026-02-13T01:25:52.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.143+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce7000dd70 con 0x7fce8010f200 2026-02-13T01:25:52.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.143+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801596b0 con 0x7fce8010f200 2026-02-13T01:25:52.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f787c0b5790 0x7f787c0d5c40 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7894125e90 0x7f78940a7f90 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78940bd0c0 0x7f789411d960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.144+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce80159b40 con 0x7fce8010f200 2026-02-13T01:25:52.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7f78a2fd46c0 1 --2- 10.20.193.28:0/3824058210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78940b6eb0 0x7f78941258b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.138+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 >> 10.20.193.28:0/3824058210 conn(0x7f7894094790 msgr2=0x7f78940b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.141+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 shutdown_connections 2026-02-13T01:25:52.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.142+0000 7f78a2fd46c0 1 -- 10.20.193.28:0/3824058210 wait complete. 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.144+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbc880b5660 msgr2=0x7fbc880d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.144+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbc880b5660 0x7fbc880d5b10 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca00099d0 tx=0x7fbca00092d0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.144+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 msgr2=0x7fbcac0b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.144+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0b0650 secure :-1 s=READY pgs=214 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca8006c20 tx=0x7fbca800cc50 comp rx=0 tx=0).stop 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.145+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 shutdown_connections 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.145+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbc880b5660 0x7fbc880d5b10 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.145+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbcac0c4a80 0x7fbcac0ab290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.145+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcac0ca0e0 0x7fbcac0b0650 unknown :-1 s=CLOSED pgs=214 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.145+0000 7fbcb93ce6c0 1 --2- 10.20.193.28:0/232922549 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbcac0c4170 0x7fbcac0aad50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.145+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 >> 10.20.193.28:0/232922549 conn(0x7fbcac01c590 msgr2=0x7fbcac0c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.146+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 shutdown_connections 2026-02-13T01:25:52.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.146+0000 7fbcb93ce6c0 1 -- 10.20.193.28:0/232922549 wait complete. 2026-02-13T01:25:52.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.148+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fce70003810 con 0x7fce8010f200 2026-02-13T01:25:52.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.150+0000 7fce5ffff6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce540b5860 0x7fce540d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.151+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fce700e4a80 con 0x7fce8010f200 2026-02-13T01:25:52.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.151+0000 7fce7e7fc6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce540b5860 0x7fce540d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.152+0000 7fce7e7fc6c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce540b5860 0x7fce540d5d10 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce80112b20 tx=0x7fce680093f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.155+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce801104d0 con 0x7fce8010f200 2026-02-13T01:25:52.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.157+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fce700a7380 con 0x7fce8010f200 2026-02-13T01:25:52.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.183+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6338005890 con 0x7f637810cf90 2026-02-13T01:25:52.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.184+0000 7f63677fe6c0 1 -- 10.20.193.28:0/2789173777 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f636c0caba0 con 0x7f637810cf90 2026-02-13T01:25:52.185 INFO:teuthology.orchestra.run.trial028.stdout:30064771099 2026-02-13T01:25:52.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f63440b57e0 msgr2=0x7f63440d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f63440b57e0 0x7f63440d5c90 secure :-1 s=READY pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f637810e970 tx=0x7f6368009260 comp rx=0 tx=0).stop 2026-02-13T01:25:52.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 msgr2=0x7f637805e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 0x7f637805e7d0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f636c005b20 tx=0x7f636c002960 comp rx=0 tx=0).stop 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 shutdown_connections 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f63440b57e0 0x7f63440d5c90 unknown :-1 s=CLOSED pgs=209 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f637805d140 0x7f6378160480 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f63781131a0 0x7f637805ca50 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 --2- 10.20.193.28:0/2789173777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f637810cf90 0x7f637805e7d0 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 >> 10.20.193.28:0/2789173777 conn(0x7f63780ea8b0 msgr2=0x7f637810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 shutdown_connections 2026-02-13T01:25:52.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.186+0000 7f63805686c0 1 -- 10.20.193.28:0/2789173777 wait complete. 2026-02-13T01:25:52.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T01:25:52.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2754860157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:52.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2376422856' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:52.202 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1659494146' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1361481792' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1657691291' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3842153832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/731117550' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3824058210' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/232922549' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:52.203 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2789173777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:52.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.202+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff220005890 con 0x7ff258116720 2026-02-13T01:25:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.205+0000 7ff2467fc6c0 1 -- 10.20.193.28:0/3929056646 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff254003810 con 0x7ff258116720 2026-02-13T01:25:52.209 INFO:teuthology.orchestra.run.trial028.stdout:223338299407 2026-02-13T01:25:52.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.208+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff2280b5710 msgr2=0x7ff2280d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.208+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff2280b5710 0x7ff2280d5bc0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff248006ae0 tx=0x7ff248006f10 comp rx=0 tx=0).stop 2026-02-13T01:25:52.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.208+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258116720 msgr2=0x7ff258123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.208+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258116720 0x7ff258123310 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff254032fd0 tx=0x7ff254005820 comp rx=0 tx=0).stop 2026-02-13T01:25:52.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.211+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 shutdown_connections 2026-02-13T01:25:52.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.211+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff258116720 0x7ff258123310 unknown :-1 s=CLOSED pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.211+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff258114910 0x7ff25811e090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.211+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff2280b5710 0x7ff2280d5bc0 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.211+0000 7ff25e08f6c0 1 --2- 10.20.193.28:0/3929056646 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff258114000 0x7ff25811db50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.211+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 >> 10.20.193.28:0/3929056646 conn(0x7ff25805aaa0 msgr2=0x7ff258119ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.212+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 shutdown_connections 2026-02-13T01:25:52.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.212+0000 7ff25e08f6c0 1 -- 10.20.193.28:0/3929056646 wait complete. 2026-02-13T01:25:52.233 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710729 got 300647710729 for osd.11 2026-02-13T01:25:52.233 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.287+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fce8010f5d0 con 0x7fce8010f200 2026-02-13T01:25:52.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.288+0000 7fce5ffff6c0 1 -- 10.20.193.28:0/527335156 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fce70003e60 con 0x7fce8010f200 2026-02-13T01:25:52.290 INFO:teuthology.orchestra.run.trial028.stdout:176093659153 2026-02-13T01:25:52.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.290+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce540b5860 msgr2=0x7fce540d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.290+0000 7fce854786c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce540b5860 0x7fce540d5d10 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce80112b20 tx=0x7fce680093f0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.290+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 msgr2=0x7fce801802c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.290+0000 7fce854786c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce801802c0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70005830 tx=0x7fce7000cbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.290+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 shutdown_connections 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce540b5860 0x7fce540d5d10 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fce8017dc20 0x7fce80158cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fce80115410 0x7fce8017d530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 --2- 10.20.193.28:0/527335156 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fce8010f200 0x7fce801802c0 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 >> 10.20.193.28:0/527335156 conn(0x7fce800ecb00 msgr2=0x7fce8010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 shutdown_connections 2026-02-13T01:25:52.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.291+0000 7fce854786c0 1 -- 10.20.193.28:0/527335156 wait complete. 2026-02-13T01:25:52.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070476 got 253403070476 for osd.9 2026-02-13T01:25:52.510 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2754860157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2376422856' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1659494146' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1361481792' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1657691291' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:52.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3842153832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:52.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/731117550' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:52.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3824058210' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:52.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/232922549' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:52.553 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2789173777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:52.563 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528335 got 193273528335 for osd.7 2026-02-13T01:25:52.563 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.567 INFO:tasks.cephadm.ceph_manager.ceph:need seq 47244640283 got 47244640283 for osd.1 2026-02-13T01:25:52.567 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.570 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771099 got 30064771099 for osd.0 2026-02-13T01:25:52.570 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051604 got 124554051605 for osd.4 2026-02-13T01:25:52.572 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.580 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299407 got 223338299407 for osd.8 2026-02-13T01:25:52.580 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.583 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659153 got 176093659153 for osd.6 2026-02-13T01:25:52.583 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:52.583 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T01:25:52.583 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:52.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T01:25:52.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2754860157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:52.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2376422856' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:52.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1659494146' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1361481792' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1657691291' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3842153832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/731117550' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3824058210' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/232922549' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:52.644 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2789173777' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:52.808 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/300868766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 msgr2=0x7fc9e810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/300868766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e810f5d0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=11153561951965522678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d40099a0 tx=0x7fc9d402ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/300868766 shutdown_connections 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/300868766 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e810fbf0 0x7fc9e8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/300868766 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc9e8115410 0x7fc9e8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/300868766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e810f5d0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=11153561951965522678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/300868766 >> 10.20.193.28:0/300868766 conn(0x7fc9e80ecb00 msgr2=0x7fc9e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:53.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/300868766 shutdown_connections 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.998+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/300868766 wait complete. 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.999+0000 7fc9ee3c86c0 1 Processor -- start 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.999+0000 7fc9ee3c86c0 1 -- start start 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.999+0000 7fc9ee3c86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e811d270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.999+0000 7fc9ee3c86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 0x7fc9e811d7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:52.999+0000 7fc9ee3c86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc9e8122b70 0x7fc9e8123010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9ee3c86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8123580 con 0x7fc9e810f200 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9ee3c86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81236f0 con 0x7fc9e8122b70 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9ee3c86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81238b0 con 0x7fc9e8115410 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 0x7fc9e811d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e7fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e811d270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 0x7fc9e811d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50320/0 (socket says 10.20.193.28:50320) 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 -- 10.20.193.28:0/2300822912 learned_addr learned my addr 10.20.193.28:0/2300822912 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9ec93a6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc9e8122b70 0x7fc9e8123010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 -- 10.20.193.28:0/2300822912 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc9e8122b70 msgr2=0x7fc9e8123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc9e8122b70 0x7fc9e8123010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 -- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 msgr2=0x7fc9e811d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e811d270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 -- 10.20.193.28:0/2300822912 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d4009590 con 0x7fc9e8115410 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e7fff6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e811d270 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e77fe6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 0x7fc9e811d7b0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d800b6c0 tx=0x7fc9d800bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:53.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9d8004250 con 0x7fc9e8115410 2026-02-13T01:25:53.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc9d8009070 con 0x7fc9e8115410 2026-02-13T01:25:53.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e8163d60 con 0x7fc9e8115410 2026-02-13T01:25:53.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.000+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9d800cd20 con 0x7fc9e8115410 2026-02-13T01:25:53.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.001+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e81641f0 con 0x7fc9e8115410 2026-02-13T01:25:53.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.001+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac005310 con 0x7fc9e8115410 2026-02-13T01:25:53.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.003+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fc9d80028c0 con 0x7fc9e8115410 2026-02-13T01:25:53.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.005+0000 7fc9e57fa6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc9bc0b5710 0x7fc9bc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.005+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fc9d80e3ac0 con 0x7fc9e8115410 2026-02-13T01:25:53.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.005+0000 7fc9e7fff6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc9bc0b5710 0x7fc9bc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.005+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc9d811c5e0 con 0x7fc9e8115410 2026-02-13T01:25:53.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.006+0000 7fc9e7fff6c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc9bc0b5710 0x7fc9bc0d5bc0 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d402f950 tx=0x7fc9d40023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:53.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.104+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9ac002bc0 con 0x7fc9bc0b5710 2026-02-13T01:25:53.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.107+0000 7fc9e57fa6c0 1 -- 10.20.193.28:0/2300822912 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258532 (secure 0 0 0) 0x7fc9ac002bc0 con 0x7fc9bc0b5710 2026-02-13T01:25:53.110 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:53.112 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:53.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc9bc0b5710 msgr2=0x7fc9bc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc9bc0b5710 0x7fc9bc0d5bc0 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d402f950 tx=0x7fc9d40023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 msgr2=0x7fc9e811d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 0x7fc9e811d7b0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9d800b6c0 tx=0x7fc9d800bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:53.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 shutdown_connections 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc9bc0b5710 0x7fc9bc0d5bc0 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc9e8115410 0x7fc9e811d7b0 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc9e8122b70 0x7fc9e8123010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 --2- 10.20.193.28:0/2300822912 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e810f200 0x7fc9e811d270 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 >> 10.20.193.28:0/2300822912 conn(0x7fc9e80ecb00 msgr2=0x7fc9e810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 shutdown_connections 2026-02-13T01:25:53.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.109+0000 7fc9ee3c86c0 1 -- 10.20.193.28:0/2300822912 wait complete. 2026-02-13T01:25:53.248 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2026-02-13T01:25:52.701927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649564,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":191,"num_read_kb":195,"num_write":344,"num_write_kb":3824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":285,"ondisk_log_size":285,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333588,"kb_used_data":10020,"kb_used_omap":404,"kb_used_meta":322923,"kb_avail":8807704812,"statfs":{"total":9019431321600,"available":9019089727488,"internally_reserved":0,"allocated":10260480,"data_stored":6586316,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":414596,"internal_metadata":330673276},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29399,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":58,"num_read_kb":76,"num_write":29,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001795"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190205+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:50.190205+0000","last_peered":"2026-02-13T01:25:50.190205+0000","last_clean":"2026-02-13T01:25:50.190205+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:50.190205+0000","last_undegraded":"2026-02-13T01:25:50.190205+0000","last_fullsized":"2026-02-13T01:25:50.190205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191888+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:50.191888+0000","last_peered":"2026-02-13T01:25:50.191888+0000","last_clean":"2026-02-13T01:25:50.191888+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:50.191888+0000","last_undegraded":"2026-02-13T01:25:50.191888+0000","last_fullsized":"2026-02-13T01:25:50.191888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191833+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:50.191833+0000","last_peered":"2026-02-13T01:25:50.191833+0000","last_clean":"2026-02-13T01:25:50.191833+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:50.191833+0000","last_undegraded":"2026-02-13T01:25:50.191833+0000","last_fullsized":"2026-02-13T01:25:50.191833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191196+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:50.191196+0000","last_peered":"2026-02-13T01:25:50.191196+0000","last_clean":"2026-02-13T01:25:50.191196+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:50.191196+0000","last_undegraded":"2026-02-13T01:25:50.191196+0000","last_fullsized":"2026-02-13T01:25:50.191196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190132+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:50.190132+0000","last_peered":"2026-02-13T01:25:50.190132+0000","last_clean":"2026-02-13T01:25:50.190132+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:50.190132+0000","last_undegraded":"2026-02-13T01:25:50.190132+0000","last_fullsized":"2026-02-13T01:25:50.190132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190421+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:50.190421+0000","last_peered":"2026-02-13T01:25:50.190421+0000","last_clean":"2026-02-13T01:25:50.190421+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:50.190421+0000","last_undegraded":"2026-02-13T01:25:50.190421+0000","last_fullsized":"2026-02-13T01:25:50.190421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.626144+0000","last_change":"2026-02-13T01:25:50.191627+0000","last_active":"2026-02-13T01:25:50.191627+0000","last_peered":"2026-02-13T01:25:37.626144+0000","last_clean":"2026-02-13T01:25:37.626144+0000","last_became_active":"2026-02-13T01:25:36.136618+0000","last_became_peered":"2026-02-13T01:25:36.136618+0000","last_unstale":"2026-02-13T01:25:37.626144+0000","last_undegraded":"2026-02-13T01:25:37.626144+0000","last_fullsized":"2026-02-13T01:25:37.626144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,8,9],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189000+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:50.189000+0000","last_peered":"2026-02-13T01:25:50.189000+0000","last_clean":"2026-02-13T01:25:50.189000+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:50.189000+0000","last_undegraded":"2026-02-13T01:25:50.189000+0000","last_fullsized":"2026-02-13T01:25:50.189000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191666+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:50.191666+0000","last_peered":"2026-02-13T01:25:50.191666+0000","last_clean":"2026-02-13T01:25:50.191666+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:50.191666+0000","last_undegraded":"2026-02-13T01:25:50.191666+0000","last_fullsized":"2026-02-13T01:25:50.191666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191044+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:50.191044+0000","last_peered":"2026-02-13T01:25:50.191044+0000","last_clean":"2026-02-13T01:25:50.191044+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:50.191044+0000","last_undegraded":"2026-02-13T01:25:50.191044+0000","last_fullsized":"2026-02-13T01:25:50.191044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190973+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:50.190973+0000","last_peered":"2026-02-13T01:25:50.190973+0000","last_clean":"2026-02-13T01:25:50.190973+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:50.190973+0000","last_undegraded":"2026-02-13T01:25:50.190973+0000","last_fullsized":"2026-02-13T01:25:50.190973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191453+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:50.191453+0000","last_peered":"2026-02-13T01:25:50.191453+0000","last_clean":"2026-02-13T01:25:50.191453+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:50.191453+0000","last_undegraded":"2026-02-13T01:25:50.191453+0000","last_fullsized":"2026-02-13T01:25:50.191453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195170+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:50.195170+0000","last_peered":"2026-02-13T01:25:50.195170+0000","last_clean":"2026-02-13T01:25:50.195170+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:50.195170+0000","last_undegraded":"2026-02-13T01:25:50.195170+0000","last_fullsized":"2026-02-13T01:25:50.195170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191548+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:50.191548+0000","last_peered":"2026-02-13T01:25:50.191548+0000","last_clean":"2026-02-13T01:25:50.191548+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:50.191548+0000","last_undegraded":"2026-02-13T01:25:50.191548+0000","last_fullsized":"2026-02-13T01:25:50.191548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191112+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:50.191112+0000","last_peered":"2026-02-13T01:25:50.191112+0000","last_clean":"2026-02-13T01:25:50.191112+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:50.191112+0000","last_undegraded":"2026-02-13T01:25:50.191112+0000","last_fullsized":"2026-02-13T01:25:50.191112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190406+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:50.190406+0000","last_peered":"2026-02-13T01:25:50.190406+0000","last_clean":"2026-02-13T01:25:50.190406+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:50.190406+0000","last_undegraded":"2026-02-13T01:25:50.190406+0000","last_fullsized":"2026-02-13T01:25:50.190406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190283+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:50.190283+0000","last_peered":"2026-02-13T01:25:50.190283+0000","last_clean":"2026-02-13T01:25:50.190283+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:50.190283+0000","last_undegraded":"2026-02-13T01:25:50.190283+0000","last_fullsized":"2026-02-13T01:25:50.190283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195784+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:50.195784+0000","last_peered":"2026-02-13T01:25:50.195784+0000","last_clean":"2026-02-13T01:25:50.195784+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:50.195784+0000","last_undegraded":"2026-02-13T01:25:50.195784+0000","last_fullsized":"2026-02-13T01:25:50.195784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198259+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:51.198259+0000","last_peered":"2026-02-13T01:25:51.198259+0000","last_clean":"2026-02-13T01:25:51.198259+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:51.198259+0000","last_undegraded":"2026-02-13T01:25:51.198259+0000","last_fullsized":"2026-02-13T01:25:51.198259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190175+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:50.190175+0000","last_peered":"2026-02-13T01:25:50.190175+0000","last_clean":"2026-02-13T01:25:50.190175+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:50.190175+0000","last_undegraded":"2026-02-13T01:25:50.190175+0000","last_fullsized":"2026-02-13T01:25:50.190175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195194+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:50.195194+0000","last_peered":"2026-02-13T01:25:50.195194+0000","last_clean":"2026-02-13T01:25:50.195194+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:50.195194+0000","last_undegraded":"2026-02-13T01:25:50.195194+0000","last_fullsized":"2026-02-13T01:25:50.195194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190569+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:50.190569+0000","last_peered":"2026-02-13T01:25:50.190569+0000","last_clean":"2026-02-13T01:25:50.190569+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:50.190569+0000","last_undegraded":"2026-02-13T01:25:50.190569+0000","last_fullsized":"2026-02-13T01:25:50.190569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189227+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:50.189227+0000","last_peered":"2026-02-13T01:25:50.189227+0000","last_clean":"2026-02-13T01:25:50.189227+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:50.189227+0000","last_undegraded":"2026-02-13T01:25:50.189227+0000","last_fullsized":"2026-02-13T01:25:50.189227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190325+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:50.190325+0000","last_peered":"2026-02-13T01:25:50.190325+0000","last_clean":"2026-02-13T01:25:50.190325+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:50.190325+0000","last_undegraded":"2026-02-13T01:25:50.190325+0000","last_fullsized":"2026-02-13T01:25:50.190325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189857+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:50.189857+0000","last_peered":"2026-02-13T01:25:50.189857+0000","last_clean":"2026-02-13T01:25:50.189857+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:50.189857+0000","last_undegraded":"2026-02-13T01:25:50.189857+0000","last_fullsized":"2026-02-13T01:25:50.189857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198417+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:51.198417+0000","last_peered":"2026-02-13T01:25:51.198417+0000","last_clean":"2026-02-13T01:25:51.198417+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:51.198417+0000","last_undegraded":"2026-02-13T01:25:51.198417+0000","last_fullsized":"2026-02-13T01:25:51.198417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190053+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:50.190053+0000","last_peered":"2026-02-13T01:25:50.190053+0000","last_clean":"2026-02-13T01:25:50.190053+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:50.190053+0000","last_undegraded":"2026-02-13T01:25:50.190053+0000","last_fullsized":"2026-02-13T01:25:50.190053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195318+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:50.195318+0000","last_peered":"2026-02-13T01:25:50.195318+0000","last_clean":"2026-02-13T01:25:50.195318+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:50.195318+0000","last_undegraded":"2026-02-13T01:25:50.195318+0000","last_fullsized":"2026-02-13T01:25:50.195318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191704+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:50.191704+0000","last_peered":"2026-02-13T01:25:50.191704+0000","last_clean":"2026-02-13T01:25:50.191704+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:50.191704+0000","last_undegraded":"2026-02-13T01:25:50.191704+0000","last_fullsized":"2026-02-13T01:25:50.191704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198114+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:51.198114+0000","last_peered":"2026-02-13T01:25:51.198114+0000","last_clean":"2026-02-13T01:25:51.198114+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:51.198114+0000","last_undegraded":"2026-02-13T01:25:51.198114+0000","last_fullsized":"2026-02-13T01:25:51.198114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198181+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:51.198181+0000","last_peered":"2026-02-13T01:25:51.198181+0000","last_clean":"2026-02-13T01:25:51.198181+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:51.198181+0000","last_undegraded":"2026-02-13T01:25:51.198181+0000","last_fullsized":"2026-02-13T01:25:51.198181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190078+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:50.190078+0000","last_peered":"2026-02-13T01:25:50.190078+0000","last_clean":"2026-02-13T01:25:50.190078+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:50.190078+0000","last_undegraded":"2026-02-13T01:25:50.190078+0000","last_fullsized":"2026-02-13T01:25:50.190078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190440+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:50.190440+0000","last_peered":"2026-02-13T01:25:50.190440+0000","last_clean":"2026-02-13T01:25:50.190440+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:50.190440+0000","last_undegraded":"2026-02-13T01:25:50.190440+0000","last_fullsized":"2026-02-13T01:25:50.190440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190437+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:50.190437+0000","last_peered":"2026-02-13T01:25:50.190437+0000","last_clean":"2026-02-13T01:25:50.190437+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:50.190437+0000","last_undegraded":"2026-02-13T01:25:50.190437+0000","last_fullsized":"2026-02-13T01:25:50.190437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.747845+0000","last_change":"2026-02-13T01:25:50.190840+0000","last_active":"2026-02-13T01:25:50.190840+0000","last_peered":"2026-02-13T01:25:38.747845+0000","last_clean":"2026-02-13T01:25:38.747845+0000","last_became_active":"2026-02-13T01:25:36.141933+0000","last_became_peered":"2026-02-13T01:25:36.141933+0000","last_unstale":"2026-02-13T01:25:38.747845+0000","last_undegraded":"2026-02-13T01:25:38.747845+0000","last_fullsized":"2026-02-13T01:25:38.747845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190556+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:50.190556+0000","last_peered":"2026-02-13T01:25:50.190556+0000","last_clean":"2026-02-13T01:25:50.190556+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:50.190556+0000","last_undegraded":"2026-02-13T01:25:50.190556+0000","last_fullsized":"2026-02-13T01:25:50.190556+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194232+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:50.194232+0000","last_peered":"2026-02-13T01:25:50.194232+0000","last_clean":"2026-02-13T01:25:50.194232+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:50.194232+0000","last_undegraded":"2026-02-13T01:25:50.194232+0000","last_fullsized":"2026-02-13T01:25:50.194232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189282+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:50.189282+0000","last_peered":"2026-02-13T01:25:50.189282+0000","last_clean":"2026-02-13T01:25:50.189282+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:50.189282+0000","last_undegraded":"2026-02-13T01:25:50.189282+0000","last_fullsized":"2026-02-13T01:25:50.189282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190696+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:50.190696+0000","last_peered":"2026-02-13T01:25:50.190696+0000","last_clean":"2026-02-13T01:25:50.190696+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:50.190696+0000","last_undegraded":"2026-02-13T01:25:50.190696+0000","last_fullsized":"2026-02-13T01:25:50.190696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.817516+0000","last_change":"2026-02-13T01:25:50.193701+0000","last_active":"2026-02-13T01:25:50.193701+0000","last_peered":"2026-02-13T01:25:39.817516+0000","last_clean":"2026-02-13T01:25:39.817516+0000","last_became_active":"2026-02-13T01:25:36.146372+0000","last_became_peered":"2026-02-13T01:25:36.146372+0000","last_unstale":"2026-02-13T01:25:39.817516+0000","last_undegraded":"2026-02-13T01:25:39.817516+0000","last_fullsized":"2026-02-13T01:25:39.817516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6,10],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191214+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:50.191214+0000","last_peered":"2026-02-13T01:25:50.191214+0000","last_clean":"2026-02-13T01:25:50.191214+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:50.191214+0000","last_undegraded":"2026-02-13T01:25:50.191214+0000","last_fullsized":"2026-02-13T01:25:50.191214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191488+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:50.191488+0000","last_peered":"2026-02-13T01:25:50.191488+0000","last_clean":"2026-02-13T01:25:50.191488+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:50.191488+0000","last_undegraded":"2026-02-13T01:25:50.191488+0000","last_fullsized":"2026-02-13T01:25:50.191488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190950+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:50.190950+0000","last_peered":"2026-02-13T01:25:50.190950+0000","last_clean":"2026-02-13T01:25:50.190950+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:50.190950+0000","last_undegraded":"2026-02-13T01:25:50.190950+0000","last_fullsized":"2026-02-13T01:25:50.190950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.790444+0000","last_change":"2026-02-13T01:25:50.189819+0000","last_active":"2026-02-13T01:25:50.189819+0000","last_peered":"2026-02-13T01:25:37.790444+0000","last_clean":"2026-02-13T01:25:37.790444+0000","last_became_active":"2026-02-13T01:25:36.141935+0000","last_became_peered":"2026-02-13T01:25:36.141935+0000","last_unstale":"2026-02-13T01:25:37.790444+0000","last_undegraded":"2026-02-13T01:25:37.790444+0000","last_fullsized":"2026-02-13T01:25:37.790444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190786+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:50.190786+0000","last_peered":"2026-02-13T01:25:50.190786+0000","last_clean":"2026-02-13T01:25:50.190786+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:50.190786+0000","last_undegraded":"2026-02-13T01:25:50.190786+0000","last_fullsized":"2026-02-13T01:25:50.190786+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191348+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:50.191348+0000","last_peered":"2026-02-13T01:25:50.191348+0000","last_clean":"2026-02-13T01:25:50.191348+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:50.191348+0000","last_undegraded":"2026-02-13T01:25:50.191348+0000","last_fullsized":"2026-02-13T01:25:50.191348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'23","reported_seq":67,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191048+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:50.191048+0000","last_peered":"2026-02-13T01:25:50.191048+0000","last_clean":"2026-02-13T01:25:50.191048+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:50.191048+0000","last_undegraded":"2026-02-13T01:25:50.191048+0000","last_fullsized":"2026-02-13T01:25:50.191048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54876,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":65,"num_write":24,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190236+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:50.190236+0000","last_peered":"2026-02-13T01:25:50.190236+0000","last_clean":"2026-02-13T01:25:50.190236+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:50.190236+0000","last_undegraded":"2026-02-13T01:25:50.190236+0000","last_fullsized":"2026-02-13T01:25:50.190236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198199+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:51.198199+0000","last_peered":"2026-02-13T01:25:51.198199+0000","last_clean":"2026-02-13T01:25:51.198199+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:51.198199+0000","last_undegraded":"2026-02-13T01:25:51.198199+0000","last_fullsized":"2026-02-13T01:25:51.198199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194241+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:50.194241+0000","last_peered":"2026-02-13T01:25:50.194241+0000","last_clean":"2026-02-13T01:25:50.194241+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:50.194241+0000","last_undegraded":"2026-02-13T01:25:50.194241+0000","last_fullsized":"2026-02-13T01:25:50.194241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190320+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:50.190320+0000","last_peered":"2026-02-13T01:25:50.190320+0000","last_clean":"2026-02-13T01:25:50.190320+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:50.190320+0000","last_undegraded":"2026-02-13T01:25:50.190320+0000","last_fullsized":"2026-02-13T01:25:50.190320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191360+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:50.191360+0000","last_peered":"2026-02-13T01:25:50.191360+0000","last_clean":"2026-02-13T01:25:50.191360+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:50.191360+0000","last_undegraded":"2026-02-13T01:25:50.191360+0000","last_fullsized":"2026-02-13T01:25:50.191360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190813+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:50.190813+0000","last_peered":"2026-02-13T01:25:50.190813+0000","last_clean":"2026-02-13T01:25:50.190813+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:50.190813+0000","last_undegraded":"2026-02-13T01:25:50.190813+0000","last_fullsized":"2026-02-13T01:25:50.190813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190863+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:50.190863+0000","last_peered":"2026-02-13T01:25:50.190863+0000","last_clean":"2026-02-13T01:25:50.190863+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:50.190863+0000","last_undegraded":"2026-02-13T01:25:50.190863+0000","last_fullsized":"2026-02-13T01:25:50.190863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190084+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:50.190084+0000","last_peered":"2026-02-13T01:25:50.190084+0000","last_clean":"2026-02-13T01:25:50.190084+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:50.190084+0000","last_undegraded":"2026-02-13T01:25:50.190084+0000","last_fullsized":"2026-02-13T01:25:50.190084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190238+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:50.190238+0000","last_peered":"2026-02-13T01:25:50.190238+0000","last_clean":"2026-02-13T01:25:50.190238+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:50.190238+0000","last_undegraded":"2026-02-13T01:25:50.190238+0000","last_fullsized":"2026-02-13T01:25:50.190238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190292+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:50.190292+0000","last_peered":"2026-02-13T01:25:50.190292+0000","last_clean":"2026-02-13T01:25:50.190292+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:50.190292+0000","last_undegraded":"2026-02-13T01:25:50.190292+0000","last_fullsized":"2026-02-13T01:25:50.190292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.889644+0000","last_change":"2026-02-13T01:25:50.190333+0000","last_active":"2026-02-13T01:25:50.190333+0000","last_peered":"2026-02-13T01:25:39.889644+0000","last_clean":"2026-02-13T01:25:39.889644+0000","last_became_active":"2026-02-13T01:25:36.138102+0000","last_became_peered":"2026-02-13T01:25:36.138102+0000","last_unstale":"2026-02-13T01:25:39.889644+0000","last_undegraded":"2026-02-13T01:25:39.889644+0000","last_fullsized":"2026-02-13T01:25:39.889644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195305+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:50.195305+0000","last_peered":"2026-02-13T01:25:50.195305+0000","last_clean":"2026-02-13T01:25:50.195305+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:50.195305+0000","last_undegraded":"2026-02-13T01:25:50.195305+0000","last_fullsized":"2026-02-13T01:25:50.195305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191659+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:50.191659+0000","last_peered":"2026-02-13T01:25:50.191659+0000","last_clean":"2026-02-13T01:25:50.191659+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:50.191659+0000","last_undegraded":"2026-02-13T01:25:50.191659+0000","last_fullsized":"2026-02-13T01:25:50.191659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190958+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:50.190958+0000","last_peered":"2026-02-13T01:25:50.190958+0000","last_clean":"2026-02-13T01:25:50.190958+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:50.190958+0000","last_undegraded":"2026-02-13T01:25:50.190958+0000","last_fullsized":"2026-02-13T01:25:50.190958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":16,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:43.404136+0000","last_change":"2026-02-13T01:25:50.191853+0000","last_active":"2026-02-13T01:25:50.191853+0000","last_peered":"2026-02-13T01:25:43.404136+0000","last_clean":"2026-02-13T01:25:43.404136+0000","last_became_active":"2026-02-13T01:25:36.140854+0000","last_became_peered":"2026-02-13T01:25:36.140854+0000","last_unstale":"2026-02-13T01:25:43.404136+0000","last_undegraded":"2026-02-13T01:25:43.404136+0000","last_fullsized":"2026-02-13T01:25:43.404136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5,8],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198298+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:51.198298+0000","last_peered":"2026-02-13T01:25:51.198298+0000","last_clean":"2026-02-13T01:25:51.198298+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:51.198298+0000","last_undegraded":"2026-02-13T01:25:51.198298+0000","last_fullsized":"2026-02-13T01:25:51.198298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":341,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191117+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:50.191117+0000","last_peered":"2026-02-13T01:25:50.191117+0000","last_clean":"2026-02-13T01:25:50.191117+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:50.191117+0000","last_undegraded":"2026-02-13T01:25:50.191117+0000","last_fullsized":"2026-02-13T01:25:50.191117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191819+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:50.191819+0000","last_peered":"2026-02-13T01:25:50.191819+0000","last_clean":"2026-02-13T01:25:50.191819+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:50.191819+0000","last_undegraded":"2026-02-13T01:25:50.191819+0000","last_fullsized":"2026-02-13T01:25:50.191819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.188635+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:50.188635+0000","last_peered":"2026-02-13T01:25:50.188635+0000","last_clean":"2026-02-13T01:25:50.188635+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:50.188635+0000","last_undegraded":"2026-02-13T01:25:50.188635+0000","last_fullsized":"2026-02-13T01:25:50.188635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191028+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:50.191028+0000","last_peered":"2026-02-13T01:25:50.191028+0000","last_clean":"2026-02-13T01:25:50.191028+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:50.191028+0000","last_undegraded":"2026-02-13T01:25:50.191028+0000","last_fullsized":"2026-02-13T01:25:50.191028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194191+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:50.194191+0000","last_peered":"2026-02-13T01:25:50.194191+0000","last_clean":"2026-02-13T01:25:50.194191+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:50.194191+0000","last_undegraded":"2026-02-13T01:25:50.194191+0000","last_fullsized":"2026-02-13T01:25:50.194191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194250+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:50.194250+0000","last_peered":"2026-02-13T01:25:50.194250+0000","last_clean":"2026-02-13T01:25:50.194250+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:50.194250+0000","last_undegraded":"2026-02-13T01:25:50.194250+0000","last_fullsized":"2026-02-13T01:25:50.194250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.747807+0000","last_change":"2026-02-13T01:25:50.191189+0000","last_active":"2026-02-13T01:25:50.191189+0000","last_peered":"2026-02-13T01:25:38.747807+0000","last_clean":"2026-02-13T01:25:38.747807+0000","last_became_active":"2026-02-13T01:25:36.138947+0000","last_became_peered":"2026-02-13T01:25:36.138947+0000","last_unstale":"2026-02-13T01:25:38.747807+0000","last_undegraded":"2026-02-13T01:25:38.747807+0000","last_fullsized":"2026-02-13T01:25:38.747807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190745+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:50.190745+0000","last_peered":"2026-02-13T01:25:50.190745+0000","last_clean":"2026-02-13T01:25:50.190745+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:50.190745+0000","last_undegraded":"2026-02-13T01:25:50.190745+0000","last_fullsized":"2026-02-13T01:25:50.190745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195371+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:50.195371+0000","last_peered":"2026-02-13T01:25:50.195371+0000","last_clean":"2026-02-13T01:25:50.195371+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:50.195371+0000","last_undegraded":"2026-02-13T01:25:50.195371+0000","last_fullsized":"2026-02-13T01:25:50.195371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191183+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:50.191183+0000","last_peered":"2026-02-13T01:25:50.191183+0000","last_clean":"2026-02-13T01:25:50.191183+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:50.191183+0000","last_undegraded":"2026-02-13T01:25:50.191183+0000","last_fullsized":"2026-02-13T01:25:50.191183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190447+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:50.190447+0000","last_peered":"2026-02-13T01:25:50.190447+0000","last_clean":"2026-02-13T01:25:50.190447+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:50.190447+0000","last_undegraded":"2026-02-13T01:25:50.190447+0000","last_fullsized":"2026-02-13T01:25:50.190447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195342+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:50.195342+0000","last_peered":"2026-02-13T01:25:50.195342+0000","last_clean":"2026-02-13T01:25:50.195342+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:50.195342+0000","last_undegraded":"2026-02-13T01:25:50.195342+0000","last_fullsized":"2026-02-13T01:25:50.195342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195820+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:50.195820+0000","last_peered":"2026-02-13T01:25:50.195820+0000","last_clean":"2026-02-13T01:25:50.195820+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:50.195820+0000","last_undegraded":"2026-02-13T01:25:50.195820+0000","last_fullsized":"2026-02-13T01:25:50.195820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189892+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:50.189892+0000","last_peered":"2026-02-13T01:25:50.189892+0000","last_clean":"2026-02-13T01:25:50.189892+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:50.189892+0000","last_undegraded":"2026-02-13T01:25:50.189892+0000","last_fullsized":"2026-02-13T01:25:50.189892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191449+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:50.191449+0000","last_peered":"2026-02-13T01:25:50.191449+0000","last_clean":"2026-02-13T01:25:50.191449+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:50.191449+0000","last_undegraded":"2026-02-13T01:25:50.191449+0000","last_fullsized":"2026-02-13T01:25:50.191449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191935+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:50.191935+0000","last_peered":"2026-02-13T01:25:50.191935+0000","last_clean":"2026-02-13T01:25:50.191935+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:50.191935+0000","last_undegraded":"2026-02-13T01:25:50.191935+0000","last_fullsized":"2026-02-13T01:25:50.191935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.865000+0000","last_change":"2026-02-13T01:25:50.190866+0000","last_active":"2026-02-13T01:25:50.190866+0000","last_peered":"2026-02-13T01:25:38.865000+0000","last_clean":"2026-02-13T01:25:38.865000+0000","last_became_active":"2026-02-13T01:25:35.141256+0000","last_became_peered":"2026-02-13T01:25:35.141256+0000","last_unstale":"2026-02-13T01:25:38.865000+0000","last_undegraded":"2026-02-13T01:25:38.865000+0000","last_fullsized":"2026-02-13T01:25:38.865000+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190130+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:50.190130+0000","last_peered":"2026-02-13T01:25:50.190130+0000","last_clean":"2026-02-13T01:25:50.190130+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:50.190130+0000","last_undegraded":"2026-02-13T01:25:50.190130+0000","last_fullsized":"2026-02-13T01:25:50.190130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189254+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:50.189254+0000","last_peered":"2026-02-13T01:25:50.189254+0000","last_clean":"2026-02-13T01:25:50.189254+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:50.189254+0000","last_undegraded":"2026-02-13T01:25:50.189254+0000","last_fullsized":"2026-02-13T01:25:50.189254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190396+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:50.190396+0000","last_peered":"2026-02-13T01:25:50.190396+0000","last_clean":"2026-02-13T01:25:50.190396+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:50.190396+0000","last_undegraded":"2026-02-13T01:25:50.190396+0000","last_fullsized":"2026-02-13T01:25:50.190396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198130+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:51.198130+0000","last_peered":"2026-02-13T01:25:51.198130+0000","last_clean":"2026-02-13T01:25:51.198130+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:51.198130+0000","last_undegraded":"2026-02-13T01:25:51.198130+0000","last_fullsized":"2026-02-13T01:25:51.198130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189695+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:50.189695+0000","last_peered":"2026-02-13T01:25:50.189695+0000","last_clean":"2026-02-13T01:25:50.189695+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:50.189695+0000","last_undegraded":"2026-02-13T01:25:50.189695+0000","last_fullsized":"2026-02-13T01:25:50.189695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190150+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:50.190150+0000","last_peered":"2026-02-13T01:25:50.190150+0000","last_clean":"2026-02-13T01:25:50.190150+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:50.190150+0000","last_undegraded":"2026-02-13T01:25:50.190150+0000","last_fullsized":"2026-02-13T01:25:50.190150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191207+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:50.191207+0000","last_peered":"2026-02-13T01:25:50.191207+0000","last_clean":"2026-02-13T01:25:50.191207+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:50.191207+0000","last_undegraded":"2026-02-13T01:25:50.191207+0000","last_fullsized":"2026-02-13T01:25:50.191207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190787+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:50.190787+0000","last_peered":"2026-02-13T01:25:50.190787+0000","last_clean":"2026-02-13T01:25:50.190787+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:50.190787+0000","last_undegraded":"2026-02-13T01:25:50.190787+0000","last_fullsized":"2026-02-13T01:25:50.190787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190250+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:50.190250+0000","last_peered":"2026-02-13T01:25:50.190250+0000","last_clean":"2026-02-13T01:25:50.190250+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:50.190250+0000","last_undegraded":"2026-02-13T01:25:50.190250+0000","last_fullsized":"2026-02-13T01:25:50.190250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191230+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:50.191230+0000","last_peered":"2026-02-13T01:25:50.191230+0000","last_clean":"2026-02-13T01:25:50.191230+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:50.191230+0000","last_undegraded":"2026-02-13T01:25:50.191230+0000","last_fullsized":"2026-02-13T01:25:50.191230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:38.432332+0000","last_change":"2026-02-13T01:25:50.570263+0000","last_active":"2026-02-13T01:25:50.570263+0000","last_peered":"2026-02-13T01:25:38.432332+0000","last_clean":"2026-02-13T01:25:38.432332+0000","last_became_active":"2026-02-13T01:25:35.134066+0000","last_became_peered":"2026-02-13T01:25:35.134066+0000","last_unstale":"2026-02-13T01:25:38.432332+0000","last_undegraded":"2026-02-13T01:25:38.432332+0000","last_fullsized":"2026-02-13T01:25:38.432332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190708+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:50.190708+0000","last_peered":"2026-02-13T01:25:50.190708+0000","last_clean":"2026-02-13T01:25:50.190708+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:50.190708+0000","last_undegraded":"2026-02-13T01:25:50.190708+0000","last_fullsized":"2026-02-13T01:25:50.190708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189166+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:50.189166+0000","last_peered":"2026-02-13T01:25:50.189166+0000","last_clean":"2026-02-13T01:25:50.189166+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:50.189166+0000","last_undegraded":"2026-02-13T01:25:50.189166+0000","last_fullsized":"2026-02-13T01:25:50.189166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:36.137991+0000","last_change":"2026-02-13T01:25:50.461647+0000","last_active":"2026-02-13T01:25:50.461647+0000","last_peered":"2026-02-13T01:25:35.123396+0000","last_clean":"2026-02-13T01:25:35.123396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-13T01:25:36.137991+0000","last_undegraded":"2026-02-13T01:25:36.137991+0000","last_fullsized":"2026-02-13T01:25:36.137991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195664+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:50.195664+0000","last_peered":"2026-02-13T01:25:50.195664+0000","last_clean":"2026-02-13T01:25:50.195664+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:50.195664+0000","last_undegraded":"2026-02-13T01:25:50.195664+0000","last_fullsized":"2026-02-13T01:25:50.195664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58962,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":85,"num_read_kb":104,"num_write":153,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":176886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153448,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":389920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6660,"internal_metadata":27583996},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939658,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27892,"kb_used_data":928,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975308,"statfs":{"total":751619276800,"available":751590715392,"internally_reserved":0,"allocated":950272,"data_stored":1027735,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25621,"internal_metadata":27565035},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32377,"internal_metadata":27558279},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":982025,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19535,"internal_metadata":27571121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":389523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27743,"internal_metadata":27562913},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920788,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":981709,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33384,"internal_metadata":27557272},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051605,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":381418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40761,"internal_metadata":27549895},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280534,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":389834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49165,"internal_metadata":27541491},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":445974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59562,"internal_metadata":27531094},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":444192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771099,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":390838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46671,"internal_metadata":27543985},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2299,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33504,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30263,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11057,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8230,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20472,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12916,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23697,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2424,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:53.255 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:53.438 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:53.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:53 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3929056646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:53.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:53 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/527335156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:53.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:53 trial028 ceph-mon[22984]: pgmap v206: 97 pgs: 10 peering, 87 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2026-02-13T01:25:53.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:53 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3929056646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:53.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:53 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/527335156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:53.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:53 trial134 ceph-mon[27948]: pgmap v206: 97 pgs: 10 peering, 87 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2026-02-13T01:25:53.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2569263298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb52810fbf0 msgr2=0x7fb528114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2569263298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb52810fbf0 0x7fb528114c30 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=10180512370335515927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5100099a0 tx=0x7fb51002ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:53.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2569263298 shutdown_connections 2026-02-13T01:25:53.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2569263298 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 0x7fb528175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2569263298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb52810fbf0 0x7fb528114c30 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=10180512370335515927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2569263298 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb52810f200 0x7fb52810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.636+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2569263298 >> 10.20.193.28:0/2569263298 conn(0x7fb5280ecb00 msgr2=0x7fb52810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:53.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.637+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2569263298 shutdown_connections 2026-02-13T01:25:53.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.637+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2569263298 wait complete. 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.637+0000 7fb52d5a86c0 1 Processor -- start 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.637+0000 7fb52d5a86c0 1 -- start start 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb52d5a86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb52810f200 0x7fb5280f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb52d5a86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 0x7fb528175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb52d5a86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 0x7fb5280fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb52d5a86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5280f5830 con 0x7fb5280f5140 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb52d5a86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5280fa950 con 0x7fb52810f200 2026-02-13T01:25:53.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb52d5a86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb5280fab10 con 0x7fb528115410 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 0x7fb5280fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5267fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 0x7fb528175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 0x7fb5280fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57040/0 (socket says 10.20.193.28:57040) 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 -- 10.20.193.28:0/2194513117 learned_addr learned my addr 10.20.193.28:0/2194513117 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb526ffd6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb52810f200 0x7fb5280f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 -- 10.20.193.28:0/2194513117 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 msgr2=0x7fb528175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 0x7fb528175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 -- 10.20.193.28:0/2194513117 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb52810f200 msgr2=0x7fb5280f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb52810f200 0x7fb5280f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5267fc6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 0x7fb528175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:53.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 -- 10.20.193.28:0/2194513117 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb510009590 con 0x7fb5280f5140 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb5277fe6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 0x7fb5280fa410 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb518006ea0 tx=0x7fb51800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.638+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb518003c40 con 0x7fb5280f5140 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.639+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb518003da0 con 0x7fb5280f5140 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.639+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5180081c0 con 0x7fb5280f5140 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.639+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5280fadf0 con 0x7fb5280f5140 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.639+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5280fb280 con 0x7fb5280f5140 2026-02-13T01:25:53.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.639+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5281104d0 con 0x7fb5280f5140 2026-02-13T01:25:53.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:53 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3929056646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:53.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:53 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/527335156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:53.645 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:53 trial187 ceph-mon[27464]: pgmap v206: 97 pgs: 10 peering, 87 active+clean; 634 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2026-02-13T01:25:53.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.641+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fb51800d590 con 0x7fb5280f5140 2026-02-13T01:25:53.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.643+0000 7fb507fff6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb4fc0b57e0 0x7fb4fc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:53.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.643+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fb5180e4950 con 0x7fb5280f5140 2026-02-13T01:25:53.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.643+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5180e4dd0 con 0x7fb5280f5140 2026-02-13T01:25:53.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.643+0000 7fb526ffd6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb4fc0b57e0 0x7fb4fc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:53.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.644+0000 7fb526ffd6c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb4fc0b57e0 0x7fb4fc0d5c90 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb51c004750 tx=0x7fb51c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:53.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.745+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5280fb280 con 0x7fb4fc0b57e0 2026-02-13T01:25:53.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.747+0000 7fb507fff6c0 1 -- 10.20.193.28:0/2194513117 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258532 (secure 0 0 0) 0x7fb5280fb280 con 0x7fb4fc0b57e0 2026-02-13T01:25:53.752 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:53.754 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:53.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb4fc0b57e0 msgr2=0x7fb4fc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb4fc0b57e0 0x7fb4fc0d5c90 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb51c004750 tx=0x7fb51c009390 comp rx=0 tx=0).stop 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 msgr2=0x7fb5280fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 0x7fb5280fa410 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb518006ea0 tx=0x7fb51800ce50 comp rx=0 tx=0).stop 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 shutdown_connections 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb4fc0b57e0 0x7fb4fc0d5c90 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb528115410 0x7fb528175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5280f5140 0x7fb5280fa410 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 --2- 10.20.193.28:0/2194513117 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb52810f200 0x7fb5280f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 >> 10.20.193.28:0/2194513117 conn(0x7fb5280ecb00 msgr2=0x7fb528113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 shutdown_connections 2026-02-13T01:25:53.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:53.750+0000 7fb52d5a86c0 1 -- 10.20.193.28:0/2194513117 wait complete. 2026-02-13T01:25:53.857 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2026-02-13T01:25:52.701927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649564,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":191,"num_read_kb":195,"num_write":344,"num_write_kb":3824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":285,"ondisk_log_size":285,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333588,"kb_used_data":10020,"kb_used_omap":404,"kb_used_meta":322923,"kb_avail":8807704812,"statfs":{"total":9019431321600,"available":9019089727488,"internally_reserved":0,"allocated":10260480,"data_stored":6586316,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":414596,"internal_metadata":330673276},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29399,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":58,"num_read_kb":76,"num_write":29,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001795"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190205+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:50.190205+0000","last_peered":"2026-02-13T01:25:50.190205+0000","last_clean":"2026-02-13T01:25:50.190205+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:50.190205+0000","last_undegraded":"2026-02-13T01:25:50.190205+0000","last_fullsized":"2026-02-13T01:25:50.190205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191888+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:50.191888+0000","last_peered":"2026-02-13T01:25:50.191888+0000","last_clean":"2026-02-13T01:25:50.191888+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:50.191888+0000","last_undegraded":"2026-02-13T01:25:50.191888+0000","last_fullsized":"2026-02-13T01:25:50.191888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191833+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:50.191833+0000","last_peered":"2026-02-13T01:25:50.191833+0000","last_clean":"2026-02-13T01:25:50.191833+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:50.191833+0000","last_undegraded":"2026-02-13T01:25:50.191833+0000","last_fullsized":"2026-02-13T01:25:50.191833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191196+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:50.191196+0000","last_peered":"2026-02-13T01:25:50.191196+0000","last_clean":"2026-02-13T01:25:50.191196+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:50.191196+0000","last_undegraded":"2026-02-13T01:25:50.191196+0000","last_fullsized":"2026-02-13T01:25:50.191196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190132+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:50.190132+0000","last_peered":"2026-02-13T01:25:50.190132+0000","last_clean":"2026-02-13T01:25:50.190132+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:50.190132+0000","last_undegraded":"2026-02-13T01:25:50.190132+0000","last_fullsized":"2026-02-13T01:25:50.190132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190421+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:50.190421+0000","last_peered":"2026-02-13T01:25:50.190421+0000","last_clean":"2026-02-13T01:25:50.190421+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:50.190421+0000","last_undegraded":"2026-02-13T01:25:50.190421+0000","last_fullsized":"2026-02-13T01:25:50.190421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.626144+0000","last_change":"2026-02-13T01:25:50.191627+0000","last_active":"2026-02-13T01:25:50.191627+0000","last_peered":"2026-02-13T01:25:37.626144+0000","last_clean":"2026-02-13T01:25:37.626144+0000","last_became_active":"2026-02-13T01:25:36.136618+0000","last_became_peered":"2026-02-13T01:25:36.136618+0000","last_unstale":"2026-02-13T01:25:37.626144+0000","last_undegraded":"2026-02-13T01:25:37.626144+0000","last_fullsized":"2026-02-13T01:25:37.626144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,8,9],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189000+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:50.189000+0000","last_peered":"2026-02-13T01:25:50.189000+0000","last_clean":"2026-02-13T01:25:50.189000+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:50.189000+0000","last_undegraded":"2026-02-13T01:25:50.189000+0000","last_fullsized":"2026-02-13T01:25:50.189000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191666+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:50.191666+0000","last_peered":"2026-02-13T01:25:50.191666+0000","last_clean":"2026-02-13T01:25:50.191666+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:50.191666+0000","last_undegraded":"2026-02-13T01:25:50.191666+0000","last_fullsized":"2026-02-13T01:25:50.191666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191044+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:50.191044+0000","last_peered":"2026-02-13T01:25:50.191044+0000","last_clean":"2026-02-13T01:25:50.191044+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:50.191044+0000","last_undegraded":"2026-02-13T01:25:50.191044+0000","last_fullsized":"2026-02-13T01:25:50.191044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190973+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:50.190973+0000","last_peered":"2026-02-13T01:25:50.190973+0000","last_clean":"2026-02-13T01:25:50.190973+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:50.190973+0000","last_undegraded":"2026-02-13T01:25:50.190973+0000","last_fullsized":"2026-02-13T01:25:50.190973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191453+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:50.191453+0000","last_peered":"2026-02-13T01:25:50.191453+0000","last_clean":"2026-02-13T01:25:50.191453+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:50.191453+0000","last_undegraded":"2026-02-13T01:25:50.191453+0000","last_fullsized":"2026-02-13T01:25:50.191453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195170+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:50.195170+0000","last_peered":"2026-02-13T01:25:50.195170+0000","last_clean":"2026-02-13T01:25:50.195170+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:50.195170+0000","last_undegraded":"2026-02-13T01:25:50.195170+0000","last_fullsized":"2026-02-13T01:25:50.195170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191548+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:50.191548+0000","last_peered":"2026-02-13T01:25:50.191548+0000","last_clean":"2026-02-13T01:25:50.191548+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:50.191548+0000","last_undegraded":"2026-02-13T01:25:50.191548+0000","last_fullsized":"2026-02-13T01:25:50.191548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191112+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:50.191112+0000","last_peered":"2026-02-13T01:25:50.191112+0000","last_clean":"2026-02-13T01:25:50.191112+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:50.191112+0000","last_undegraded":"2026-02-13T01:25:50.191112+0000","last_fullsized":"2026-02-13T01:25:50.191112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190406+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:50.190406+0000","last_peered":"2026-02-13T01:25:50.190406+0000","last_clean":"2026-02-13T01:25:50.190406+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:50.190406+0000","last_undegraded":"2026-02-13T01:25:50.190406+0000","last_fullsized":"2026-02-13T01:25:50.190406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190283+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:50.190283+0000","last_peered":"2026-02-13T01:25:50.190283+0000","last_clean":"2026-02-13T01:25:50.190283+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:50.190283+0000","last_undegraded":"2026-02-13T01:25:50.190283+0000","last_fullsized":"2026-02-13T01:25:50.190283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195784+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:50.195784+0000","last_peered":"2026-02-13T01:25:50.195784+0000","last_clean":"2026-02-13T01:25:50.195784+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:50.195784+0000","last_undegraded":"2026-02-13T01:25:50.195784+0000","last_fullsized":"2026-02-13T01:25:50.195784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198259+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:51.198259+0000","last_peered":"2026-02-13T01:25:51.198259+0000","last_clean":"2026-02-13T01:25:51.198259+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:51.198259+0000","last_undegraded":"2026-02-13T01:25:51.198259+0000","last_fullsized":"2026-02-13T01:25:51.198259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190175+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:50.190175+0000","last_peered":"2026-02-13T01:25:50.190175+0000","last_clean":"2026-02-13T01:25:50.190175+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:50.190175+0000","last_undegraded":"2026-02-13T01:25:50.190175+0000","last_fullsized":"2026-02-13T01:25:50.190175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195194+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:50.195194+0000","last_peered":"2026-02-13T01:25:50.195194+0000","last_clean":"2026-02-13T01:25:50.195194+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:50.195194+0000","last_undegraded":"2026-02-13T01:25:50.195194+0000","last_fullsized":"2026-02-13T01:25:50.195194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190569+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:50.190569+0000","last_peered":"2026-02-13T01:25:50.190569+0000","last_clean":"2026-02-13T01:25:50.190569+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:50.190569+0000","last_undegraded":"2026-02-13T01:25:50.190569+0000","last_fullsized":"2026-02-13T01:25:50.190569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189227+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:50.189227+0000","last_peered":"2026-02-13T01:25:50.189227+0000","last_clean":"2026-02-13T01:25:50.189227+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:50.189227+0000","last_undegraded":"2026-02-13T01:25:50.189227+0000","last_fullsized":"2026-02-13T01:25:50.189227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190325+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:50.190325+0000","last_peered":"2026-02-13T01:25:50.190325+0000","last_clean":"2026-02-13T01:25:50.190325+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:50.190325+0000","last_undegraded":"2026-02-13T01:25:50.190325+0000","last_fullsized":"2026-02-13T01:25:50.190325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189857+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:50.189857+0000","last_peered":"2026-02-13T01:25:50.189857+0000","last_clean":"2026-02-13T01:25:50.189857+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:50.189857+0000","last_undegraded":"2026-02-13T01:25:50.189857+0000","last_fullsized":"2026-02-13T01:25:50.189857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198417+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:51.198417+0000","last_peered":"2026-02-13T01:25:51.198417+0000","last_clean":"2026-02-13T01:25:51.198417+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:51.198417+0000","last_undegraded":"2026-02-13T01:25:51.198417+0000","last_fullsized":"2026-02-13T01:25:51.198417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190053+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:50.190053+0000","last_peered":"2026-02-13T01:25:50.190053+0000","last_clean":"2026-02-13T01:25:50.190053+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:50.190053+0000","last_undegraded":"2026-02-13T01:25:50.190053+0000","last_fullsized":"2026-02-13T01:25:50.190053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195318+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:50.195318+0000","last_peered":"2026-02-13T01:25:50.195318+0000","last_clean":"2026-02-13T01:25:50.195318+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:50.195318+0000","last_undegraded":"2026-02-13T01:25:50.195318+0000","last_fullsized":"2026-02-13T01:25:50.195318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191704+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:50.191704+0000","last_peered":"2026-02-13T01:25:50.191704+0000","last_clean":"2026-02-13T01:25:50.191704+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:50.191704+0000","last_undegraded":"2026-02-13T01:25:50.191704+0000","last_fullsized":"2026-02-13T01:25:50.191704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198114+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:51.198114+0000","last_peered":"2026-02-13T01:25:51.198114+0000","last_clean":"2026-02-13T01:25:51.198114+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:51.198114+0000","last_undegraded":"2026-02-13T01:25:51.198114+0000","last_fullsized":"2026-02-13T01:25:51.198114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198181+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:51.198181+0000","last_peered":"2026-02-13T01:25:51.198181+0000","last_clean":"2026-02-13T01:25:51.198181+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:51.198181+0000","last_undegraded":"2026-02-13T01:25:51.198181+0000","last_fullsized":"2026-02-13T01:25:51.198181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190078+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:50.190078+0000","last_peered":"2026-02-13T01:25:50.190078+0000","last_clean":"2026-02-13T01:25:50.190078+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:50.190078+0000","last_undegraded":"2026-02-13T01:25:50.190078+0000","last_fullsized":"2026-02-13T01:25:50.190078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190440+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:50.190440+0000","last_peered":"2026-02-13T01:25:50.190440+0000","last_clean":"2026-02-13T01:25:50.190440+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:50.190440+0000","last_undegraded":"2026-02-13T01:25:50.190440+0000","last_fullsized":"2026-02-13T01:25:50.190440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190437+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:50.190437+0000","last_peered":"2026-02-13T01:25:50.190437+0000","last_clean":"2026-02-13T01:25:50.190437+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:50.190437+0000","last_undegraded":"2026-02-13T01:25:50.190437+0000","last_fullsized":"2026-02-13T01:25:50.190437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.747845+0000","last_change":"2026-02-13T01:25:50.190840+0000","last_active":"2026-02-13T01:25:50.190840+0000","last_peered":"2026-02-13T01:25:38.747845+0000","last_clean":"2026-02-13T01:25:38.747845+0000","last_became_active":"2026-02-13T01:25:36.141933+0000","last_became_peered":"2026-02-13T01:25:36.141933+0000","last_unstale":"2026-02-13T01:25:38.747845+0000","last_undegraded":"2026-02-13T01:25:38.747845+0000","last_fullsized":"2026-02-13T01:25:38.747845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190556+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:50.190556+0000","last_peered":"2026-02-13T01:25:50.190556+0000","last_clean":"2026-02-13T01:25:50.190556+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:50.190556+0000","last_undegraded":"2026-02-13T01:25:50.190556+0000","last_fullsized":"2026-02-13T01:25:50.190556+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194232+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:50.194232+0000","last_peered":"2026-02-13T01:25:50.194232+0000","last_clean":"2026-02-13T01:25:50.194232+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:50.194232+0000","last_undegraded":"2026-02-13T01:25:50.194232+0000","last_fullsized":"2026-02-13T01:25:50.194232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189282+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:50.189282+0000","last_peered":"2026-02-13T01:25:50.189282+0000","last_clean":"2026-02-13T01:25:50.189282+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:50.189282+0000","last_undegraded":"2026-02-13T01:25:50.189282+0000","last_fullsized":"2026-02-13T01:25:50.189282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190696+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:50.190696+0000","last_peered":"2026-02-13T01:25:50.190696+0000","last_clean":"2026-02-13T01:25:50.190696+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:50.190696+0000","last_undegraded":"2026-02-13T01:25:50.190696+0000","last_fullsized":"2026-02-13T01:25:50.190696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.817516+0000","last_change":"2026-02-13T01:25:50.193701+0000","last_active":"2026-02-13T01:25:50.193701+0000","last_peered":"2026-02-13T01:25:39.817516+0000","last_clean":"2026-02-13T01:25:39.817516+0000","last_became_active":"2026-02-13T01:25:36.146372+0000","last_became_peered":"2026-02-13T01:25:36.146372+0000","last_unstale":"2026-02-13T01:25:39.817516+0000","last_undegraded":"2026-02-13T01:25:39.817516+0000","last_fullsized":"2026-02-13T01:25:39.817516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6,10],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191214+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:50.191214+0000","last_peered":"2026-02-13T01:25:50.191214+0000","last_clean":"2026-02-13T01:25:50.191214+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:50.191214+0000","last_undegraded":"2026-02-13T01:25:50.191214+0000","last_fullsized":"2026-02-13T01:25:50.191214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191488+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:50.191488+0000","last_peered":"2026-02-13T01:25:50.191488+0000","last_clean":"2026-02-13T01:25:50.191488+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:50.191488+0000","last_undegraded":"2026-02-13T01:25:50.191488+0000","last_fullsized":"2026-02-13T01:25:50.191488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190950+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:50.190950+0000","last_peered":"2026-02-13T01:25:50.190950+0000","last_clean":"2026-02-13T01:25:50.190950+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:50.190950+0000","last_undegraded":"2026-02-13T01:25:50.190950+0000","last_fullsized":"2026-02-13T01:25:50.190950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.790444+0000","last_change":"2026-02-13T01:25:50.189819+0000","last_active":"2026-02-13T01:25:50.189819+0000","last_peered":"2026-02-13T01:25:37.790444+0000","last_clean":"2026-02-13T01:25:37.790444+0000","last_became_active":"2026-02-13T01:25:36.141935+0000","last_became_peered":"2026-02-13T01:25:36.141935+0000","last_unstale":"2026-02-13T01:25:37.790444+0000","last_undegraded":"2026-02-13T01:25:37.790444+0000","last_fullsized":"2026-02-13T01:25:37.790444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190786+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:50.190786+0000","last_peered":"2026-02-13T01:25:50.190786+0000","last_clean":"2026-02-13T01:25:50.190786+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:50.190786+0000","last_undegraded":"2026-02-13T01:25:50.190786+0000","last_fullsized":"2026-02-13T01:25:50.190786+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191348+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:50.191348+0000","last_peered":"2026-02-13T01:25:50.191348+0000","last_clean":"2026-02-13T01:25:50.191348+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:50.191348+0000","last_undegraded":"2026-02-13T01:25:50.191348+0000","last_fullsized":"2026-02-13T01:25:50.191348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'23","reported_seq":67,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191048+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:50.191048+0000","last_peered":"2026-02-13T01:25:50.191048+0000","last_clean":"2026-02-13T01:25:50.191048+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:50.191048+0000","last_undegraded":"2026-02-13T01:25:50.191048+0000","last_fullsized":"2026-02-13T01:25:50.191048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54876,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":65,"num_write":24,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190236+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:50.190236+0000","last_peered":"2026-02-13T01:25:50.190236+0000","last_clean":"2026-02-13T01:25:50.190236+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:50.190236+0000","last_undegraded":"2026-02-13T01:25:50.190236+0000","last_fullsized":"2026-02-13T01:25:50.190236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198199+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:51.198199+0000","last_peered":"2026-02-13T01:25:51.198199+0000","last_clean":"2026-02-13T01:25:51.198199+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:51.198199+0000","last_undegraded":"2026-02-13T01:25:51.198199+0000","last_fullsized":"2026-02-13T01:25:51.198199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194241+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:50.194241+0000","last_peered":"2026-02-13T01:25:50.194241+0000","last_clean":"2026-02-13T01:25:50.194241+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:50.194241+0000","last_undegraded":"2026-02-13T01:25:50.194241+0000","last_fullsized":"2026-02-13T01:25:50.194241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190320+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:50.190320+0000","last_peered":"2026-02-13T01:25:50.190320+0000","last_clean":"2026-02-13T01:25:50.190320+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:50.190320+0000","last_undegraded":"2026-02-13T01:25:50.190320+0000","last_fullsized":"2026-02-13T01:25:50.190320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191360+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:50.191360+0000","last_peered":"2026-02-13T01:25:50.191360+0000","last_clean":"2026-02-13T01:25:50.191360+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:50.191360+0000","last_undegraded":"2026-02-13T01:25:50.191360+0000","last_fullsized":"2026-02-13T01:25:50.191360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190813+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:50.190813+0000","last_peered":"2026-02-13T01:25:50.190813+0000","last_clean":"2026-02-13T01:25:50.190813+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:50.190813+0000","last_undegraded":"2026-02-13T01:25:50.190813+0000","last_fullsized":"2026-02-13T01:25:50.190813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190863+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:50.190863+0000","last_peered":"2026-02-13T01:25:50.190863+0000","last_clean":"2026-02-13T01:25:50.190863+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:50.190863+0000","last_undegraded":"2026-02-13T01:25:50.190863+0000","last_fullsized":"2026-02-13T01:25:50.190863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190084+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:50.190084+0000","last_peered":"2026-02-13T01:25:50.190084+0000","last_clean":"2026-02-13T01:25:50.190084+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:50.190084+0000","last_undegraded":"2026-02-13T01:25:50.190084+0000","last_fullsized":"2026-02-13T01:25:50.190084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190238+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:50.190238+0000","last_peered":"2026-02-13T01:25:50.190238+0000","last_clean":"2026-02-13T01:25:50.190238+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:50.190238+0000","last_undegraded":"2026-02-13T01:25:50.190238+0000","last_fullsized":"2026-02-13T01:25:50.190238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190292+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:50.190292+0000","last_peered":"2026-02-13T01:25:50.190292+0000","last_clean":"2026-02-13T01:25:50.190292+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:50.190292+0000","last_undegraded":"2026-02-13T01:25:50.190292+0000","last_fullsized":"2026-02-13T01:25:50.190292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.889644+0000","last_change":"2026-02-13T01:25:50.190333+0000","last_active":"2026-02-13T01:25:50.190333+0000","last_peered":"2026-02-13T01:25:39.889644+0000","last_clean":"2026-02-13T01:25:39.889644+0000","last_became_active":"2026-02-13T01:25:36.138102+0000","last_became_peered":"2026-02-13T01:25:36.138102+0000","last_unstale":"2026-02-13T01:25:39.889644+0000","last_undegraded":"2026-02-13T01:25:39.889644+0000","last_fullsized":"2026-02-13T01:25:39.889644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195305+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:50.195305+0000","last_peered":"2026-02-13T01:25:50.195305+0000","last_clean":"2026-02-13T01:25:50.195305+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:50.195305+0000","last_undegraded":"2026-02-13T01:25:50.195305+0000","last_fullsized":"2026-02-13T01:25:50.195305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191659+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:50.191659+0000","last_peered":"2026-02-13T01:25:50.191659+0000","last_clean":"2026-02-13T01:25:50.191659+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:50.191659+0000","last_undegraded":"2026-02-13T01:25:50.191659+0000","last_fullsized":"2026-02-13T01:25:50.191659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190958+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:50.190958+0000","last_peered":"2026-02-13T01:25:50.190958+0000","last_clean":"2026-02-13T01:25:50.190958+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:50.190958+0000","last_undegraded":"2026-02-13T01:25:50.190958+0000","last_fullsized":"2026-02-13T01:25:50.190958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":16,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:43.404136+0000","last_change":"2026-02-13T01:25:50.191853+0000","last_active":"2026-02-13T01:25:50.191853+0000","last_peered":"2026-02-13T01:25:43.404136+0000","last_clean":"2026-02-13T01:25:43.404136+0000","last_became_active":"2026-02-13T01:25:36.140854+0000","last_became_peered":"2026-02-13T01:25:36.140854+0000","last_unstale":"2026-02-13T01:25:43.404136+0000","last_undegraded":"2026-02-13T01:25:43.404136+0000","last_fullsized":"2026-02-13T01:25:43.404136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5,8],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198298+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:51.198298+0000","last_peered":"2026-02-13T01:25:51.198298+0000","last_clean":"2026-02-13T01:25:51.198298+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:51.198298+0000","last_undegraded":"2026-02-13T01:25:51.198298+0000","last_fullsized":"2026-02-13T01:25:51.198298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":341,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191117+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:50.191117+0000","last_peered":"2026-02-13T01:25:50.191117+0000","last_clean":"2026-02-13T01:25:50.191117+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:50.191117+0000","last_undegraded":"2026-02-13T01:25:50.191117+0000","last_fullsized":"2026-02-13T01:25:50.191117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191819+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:50.191819+0000","last_peered":"2026-02-13T01:25:50.191819+0000","last_clean":"2026-02-13T01:25:50.191819+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:50.191819+0000","last_undegraded":"2026-02-13T01:25:50.191819+0000","last_fullsized":"2026-02-13T01:25:50.191819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.188635+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:50.188635+0000","last_peered":"2026-02-13T01:25:50.188635+0000","last_clean":"2026-02-13T01:25:50.188635+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:50.188635+0000","last_undegraded":"2026-02-13T01:25:50.188635+0000","last_fullsized":"2026-02-13T01:25:50.188635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191028+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:50.191028+0000","last_peered":"2026-02-13T01:25:50.191028+0000","last_clean":"2026-02-13T01:25:50.191028+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:50.191028+0000","last_undegraded":"2026-02-13T01:25:50.191028+0000","last_fullsized":"2026-02-13T01:25:50.191028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194191+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:50.194191+0000","last_peered":"2026-02-13T01:25:50.194191+0000","last_clean":"2026-02-13T01:25:50.194191+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:50.194191+0000","last_undegraded":"2026-02-13T01:25:50.194191+0000","last_fullsized":"2026-02-13T01:25:50.194191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194250+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:50.194250+0000","last_peered":"2026-02-13T01:25:50.194250+0000","last_clean":"2026-02-13T01:25:50.194250+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:50.194250+0000","last_undegraded":"2026-02-13T01:25:50.194250+0000","last_fullsized":"2026-02-13T01:25:50.194250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.747807+0000","last_change":"2026-02-13T01:25:50.191189+0000","last_active":"2026-02-13T01:25:50.191189+0000","last_peered":"2026-02-13T01:25:38.747807+0000","last_clean":"2026-02-13T01:25:38.747807+0000","last_became_active":"2026-02-13T01:25:36.138947+0000","last_became_peered":"2026-02-13T01:25:36.138947+0000","last_unstale":"2026-02-13T01:25:38.747807+0000","last_undegraded":"2026-02-13T01:25:38.747807+0000","last_fullsized":"2026-02-13T01:25:38.747807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190745+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:50.190745+0000","last_peered":"2026-02-13T01:25:50.190745+0000","last_clean":"2026-02-13T01:25:50.190745+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:50.190745+0000","last_undegraded":"2026-02-13T01:25:50.190745+0000","last_fullsized":"2026-02-13T01:25:50.190745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195371+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:50.195371+0000","last_peered":"2026-02-13T01:25:50.195371+0000","last_clean":"2026-02-13T01:25:50.195371+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:50.195371+0000","last_undegraded":"2026-02-13T01:25:50.195371+0000","last_fullsized":"2026-02-13T01:25:50.195371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191183+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:50.191183+0000","last_peered":"2026-02-13T01:25:50.191183+0000","last_clean":"2026-02-13T01:25:50.191183+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:50.191183+0000","last_undegraded":"2026-02-13T01:25:50.191183+0000","last_fullsized":"2026-02-13T01:25:50.191183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190447+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:50.190447+0000","last_peered":"2026-02-13T01:25:50.190447+0000","last_clean":"2026-02-13T01:25:50.190447+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:50.190447+0000","last_undegraded":"2026-02-13T01:25:50.190447+0000","last_fullsized":"2026-02-13T01:25:50.190447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195342+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:50.195342+0000","last_peered":"2026-02-13T01:25:50.195342+0000","last_clean":"2026-02-13T01:25:50.195342+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:50.195342+0000","last_undegraded":"2026-02-13T01:25:50.195342+0000","last_fullsized":"2026-02-13T01:25:50.195342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195820+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:50.195820+0000","last_peered":"2026-02-13T01:25:50.195820+0000","last_clean":"2026-02-13T01:25:50.195820+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:50.195820+0000","last_undegraded":"2026-02-13T01:25:50.195820+0000","last_fullsized":"2026-02-13T01:25:50.195820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189892+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:50.189892+0000","last_peered":"2026-02-13T01:25:50.189892+0000","last_clean":"2026-02-13T01:25:50.189892+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:50.189892+0000","last_undegraded":"2026-02-13T01:25:50.189892+0000","last_fullsized":"2026-02-13T01:25:50.189892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191449+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:50.191449+0000","last_peered":"2026-02-13T01:25:50.191449+0000","last_clean":"2026-02-13T01:25:50.191449+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:50.191449+0000","last_undegraded":"2026-02-13T01:25:50.191449+0000","last_fullsized":"2026-02-13T01:25:50.191449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191935+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:50.191935+0000","last_peered":"2026-02-13T01:25:50.191935+0000","last_clean":"2026-02-13T01:25:50.191935+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:50.191935+0000","last_undegraded":"2026-02-13T01:25:50.191935+0000","last_fullsized":"2026-02-13T01:25:50.191935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.865000+0000","last_change":"2026-02-13T01:25:50.190866+0000","last_active":"2026-02-13T01:25:50.190866+0000","last_peered":"2026-02-13T01:25:38.865000+0000","last_clean":"2026-02-13T01:25:38.865000+0000","last_became_active":"2026-02-13T01:25:35.141256+0000","last_became_peered":"2026-02-13T01:25:35.141256+0000","last_unstale":"2026-02-13T01:25:38.865000+0000","last_undegraded":"2026-02-13T01:25:38.865000+0000","last_fullsized":"2026-02-13T01:25:38.865000+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190130+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:50.190130+0000","last_peered":"2026-02-13T01:25:50.190130+0000","last_clean":"2026-02-13T01:25:50.190130+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:50.190130+0000","last_undegraded":"2026-02-13T01:25:50.190130+0000","last_fullsized":"2026-02-13T01:25:50.190130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189254+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:50.189254+0000","last_peered":"2026-02-13T01:25:50.189254+0000","last_clean":"2026-02-13T01:25:50.189254+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:50.189254+0000","last_undegraded":"2026-02-13T01:25:50.189254+0000","last_fullsized":"2026-02-13T01:25:50.189254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190396+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:50.190396+0000","last_peered":"2026-02-13T01:25:50.190396+0000","last_clean":"2026-02-13T01:25:50.190396+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:50.190396+0000","last_undegraded":"2026-02-13T01:25:50.190396+0000","last_fullsized":"2026-02-13T01:25:50.190396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198130+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:51.198130+0000","last_peered":"2026-02-13T01:25:51.198130+0000","last_clean":"2026-02-13T01:25:51.198130+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:51.198130+0000","last_undegraded":"2026-02-13T01:25:51.198130+0000","last_fullsized":"2026-02-13T01:25:51.198130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189695+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:50.189695+0000","last_peered":"2026-02-13T01:25:50.189695+0000","last_clean":"2026-02-13T01:25:50.189695+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:50.189695+0000","last_undegraded":"2026-02-13T01:25:50.189695+0000","last_fullsized":"2026-02-13T01:25:50.189695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190150+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:50.190150+0000","last_peered":"2026-02-13T01:25:50.190150+0000","last_clean":"2026-02-13T01:25:50.190150+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:50.190150+0000","last_undegraded":"2026-02-13T01:25:50.190150+0000","last_fullsized":"2026-02-13T01:25:50.190150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191207+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:50.191207+0000","last_peered":"2026-02-13T01:25:50.191207+0000","last_clean":"2026-02-13T01:25:50.191207+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:50.191207+0000","last_undegraded":"2026-02-13T01:25:50.191207+0000","last_fullsized":"2026-02-13T01:25:50.191207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190787+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:50.190787+0000","last_peered":"2026-02-13T01:25:50.190787+0000","last_clean":"2026-02-13T01:25:50.190787+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:50.190787+0000","last_undegraded":"2026-02-13T01:25:50.190787+0000","last_fullsized":"2026-02-13T01:25:50.190787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190250+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:50.190250+0000","last_peered":"2026-02-13T01:25:50.190250+0000","last_clean":"2026-02-13T01:25:50.190250+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:50.190250+0000","last_undegraded":"2026-02-13T01:25:50.190250+0000","last_fullsized":"2026-02-13T01:25:50.190250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191230+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:50.191230+0000","last_peered":"2026-02-13T01:25:50.191230+0000","last_clean":"2026-02-13T01:25:50.191230+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:50.191230+0000","last_undegraded":"2026-02-13T01:25:50.191230+0000","last_fullsized":"2026-02-13T01:25:50.191230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:38.432332+0000","last_change":"2026-02-13T01:25:50.570263+0000","last_active":"2026-02-13T01:25:50.570263+0000","last_peered":"2026-02-13T01:25:38.432332+0000","last_clean":"2026-02-13T01:25:38.432332+0000","last_became_active":"2026-02-13T01:25:35.134066+0000","last_became_peered":"2026-02-13T01:25:35.134066+0000","last_unstale":"2026-02-13T01:25:38.432332+0000","last_undegraded":"2026-02-13T01:25:38.432332+0000","last_fullsized":"2026-02-13T01:25:38.432332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190708+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:50.190708+0000","last_peered":"2026-02-13T01:25:50.190708+0000","last_clean":"2026-02-13T01:25:50.190708+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:50.190708+0000","last_undegraded":"2026-02-13T01:25:50.190708+0000","last_fullsized":"2026-02-13T01:25:50.190708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189166+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:50.189166+0000","last_peered":"2026-02-13T01:25:50.189166+0000","last_clean":"2026-02-13T01:25:50.189166+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:50.189166+0000","last_undegraded":"2026-02-13T01:25:50.189166+0000","last_fullsized":"2026-02-13T01:25:50.189166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:36.137991+0000","last_change":"2026-02-13T01:25:50.461647+0000","last_active":"2026-02-13T01:25:50.461647+0000","last_peered":"2026-02-13T01:25:35.123396+0000","last_clean":"2026-02-13T01:25:35.123396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-13T01:25:36.137991+0000","last_undegraded":"2026-02-13T01:25:36.137991+0000","last_fullsized":"2026-02-13T01:25:36.137991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195664+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:50.195664+0000","last_peered":"2026-02-13T01:25:50.195664+0000","last_clean":"2026-02-13T01:25:50.195664+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:50.195664+0000","last_undegraded":"2026-02-13T01:25:50.195664+0000","last_fullsized":"2026-02-13T01:25:50.195664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58962,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":85,"num_read_kb":104,"num_write":153,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":176886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153448,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":389920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6660,"internal_metadata":27583996},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939658,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27892,"kb_used_data":928,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975308,"statfs":{"total":751619276800,"available":751590715392,"internally_reserved":0,"allocated":950272,"data_stored":1027735,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25621,"internal_metadata":27565035},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32377,"internal_metadata":27558279},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":982025,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19535,"internal_metadata":27571121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":389523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27743,"internal_metadata":27562913},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920788,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":981709,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33384,"internal_metadata":27557272},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051605,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":381418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40761,"internal_metadata":27549895},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280534,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":389834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49165,"internal_metadata":27541491},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":445974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59562,"internal_metadata":27531094},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":444192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771099,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":390838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46671,"internal_metadata":27543985},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2299,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33504,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30263,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11057,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8230,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20472,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12916,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23697,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2424,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:53.864 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:54.048 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:54.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 -- 10.20.193.28:0/589506366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 msgr2=0x7f682011b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/589506366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 0x7f682011b8e0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=5378335549758712841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6814009970 tx=0x7f681402ed10 comp rx=0 tx=0).stop 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 -- 10.20.193.28:0/589506366 shutdown_connections 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/589506366 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68201149c0 0x7f6820114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/589506366 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f6820114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/589506366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 0x7f682011b8e0 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=5378335549758712841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 -- 10.20.193.28:0/589506366 >> 10.20.193.28:0/589506366 conn(0x7f6820058a50 msgr2=0x7f6820058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 -- 10.20.193.28:0/589506366 shutdown_connections 2026-02-13T01:25:54.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.244+0000 7f68258bb6c0 1 -- 10.20.193.28:0/589506366 wait complete. 2026-02-13T01:25:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 Processor -- start 2026-02-13T01:25:54.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 -- start start 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f682012b8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68201149c0 0x7f682012be30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 0x7f68201311a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f68201317f0 con 0x7f682011b510 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6820131960 con 0x7f6820113dc0 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.245+0000 7f68258bb6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6820131b20 con 0x7f68201149c0 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f682012b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681e7fc6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68201149c0 0x7f682012be30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f682012b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:52796/0 (socket says 10.20.193.28:52796) 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 -- 10.20.193.28:0/1754505495 learned_addr learned my addr 10.20.193.28:0/1754505495 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:54.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681f7fe6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 0x7f68201311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 -- 10.20.193.28:0/1754505495 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68201149c0 msgr2=0x7f682012be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68201149c0 0x7f682012be30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 -- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 msgr2=0x7f68201311a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 0x7f68201311a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 -- 10.20.193.28:0/1754505495 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6814009590 con 0x7f6820113dc0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.246+0000 7f681effd6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f682012b8f0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68140098c0 tx=0x7f68140047f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.247+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6814002ae0 con 0x7f6820113dc0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.247+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6814002c40 con 0x7f6820113dc0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.247+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6820131da0 con 0x7f6820113dc0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.247+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68140312b0 con 0x7f6820113dc0 2026-02-13T01:25:54.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.247+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68201724e0 con 0x7f6820113dc0 2026-02-13T01:25:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.247+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682005b000 con 0x7f6820113dc0 2026-02-13T01:25:54.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.249+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f6814007260 con 0x7f6820113dc0 2026-02-13T01:25:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.251+0000 7f68248b56c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f67f40b5690 0x7f67f40d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.251+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f6814107cc0 con 0x7f6820113dc0 2026-02-13T01:25:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.251+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6814108140 con 0x7f6820113dc0 2026-02-13T01:25:54.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.251+0000 7f681e7fc6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f67f40b5690 0x7f67f40d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.252+0000 7f681e7fc6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f67f40b5690 0x7f67f40d5b40 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6820132230 tx=0x7f6808009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.349+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f682012c9f0 con 0x7f67f40b5690 2026-02-13T01:25:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:54 trial028 ceph-mon[22984]: from='client.24865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:54 trial028 ceph-mon[22984]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:54.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.352+0000 7f68248b56c0 1 -- 10.20.193.28:0/1754505495 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258532 (secure 0 0 0) 0x7f682012c9f0 con 0x7f67f40b5690 2026-02-13T01:25:54.356 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:54.357 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:54.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f67f40b5690 msgr2=0x7f67f40d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f67f40b5690 0x7f67f40d5b40 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6820132230 tx=0x7f6808009390 comp rx=0 tx=0).stop 2026-02-13T01:25:54.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 msgr2=0x7f682012b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f682012b8f0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68140098c0 tx=0x7f68140047f0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 shutdown_connections 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f67f40b5690 0x7f67f40d5b40 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68201149c0 0x7f682012be30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f682011b510 0x7f68201311a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 --2- 10.20.193.28:0/1754505495 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f6820113dc0 0x7f682012b8f0 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.354+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 >> 10.20.193.28:0/1754505495 conn(0x7f6820058a50 msgr2=0x7f682011a970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.355+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 shutdown_connections 2026-02-13T01:25:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.355+0000 7f68258bb6c0 1 -- 10.20.193.28:0/1754505495 wait complete. 2026-02-13T01:25:54.458 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2026-02-13T01:25:52.701927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649564,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":191,"num_read_kb":195,"num_write":344,"num_write_kb":3824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":285,"ondisk_log_size":285,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333588,"kb_used_data":10020,"kb_used_omap":404,"kb_used_meta":322923,"kb_avail":8807704812,"statfs":{"total":9019431321600,"available":9019089727488,"internally_reserved":0,"allocated":10260480,"data_stored":6586316,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":414596,"internal_metadata":330673276},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29399,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":58,"num_read_kb":76,"num_write":29,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001795"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190205+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:50.190205+0000","last_peered":"2026-02-13T01:25:50.190205+0000","last_clean":"2026-02-13T01:25:50.190205+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:50.190205+0000","last_undegraded":"2026-02-13T01:25:50.190205+0000","last_fullsized":"2026-02-13T01:25:50.190205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191888+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:50.191888+0000","last_peered":"2026-02-13T01:25:50.191888+0000","last_clean":"2026-02-13T01:25:50.191888+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:50.191888+0000","last_undegraded":"2026-02-13T01:25:50.191888+0000","last_fullsized":"2026-02-13T01:25:50.191888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191833+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:50.191833+0000","last_peered":"2026-02-13T01:25:50.191833+0000","last_clean":"2026-02-13T01:25:50.191833+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:50.191833+0000","last_undegraded":"2026-02-13T01:25:50.191833+0000","last_fullsized":"2026-02-13T01:25:50.191833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191196+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:50.191196+0000","last_peered":"2026-02-13T01:25:50.191196+0000","last_clean":"2026-02-13T01:25:50.191196+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:50.191196+0000","last_undegraded":"2026-02-13T01:25:50.191196+0000","last_fullsized":"2026-02-13T01:25:50.191196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190132+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:50.190132+0000","last_peered":"2026-02-13T01:25:50.190132+0000","last_clean":"2026-02-13T01:25:50.190132+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:50.190132+0000","last_undegraded":"2026-02-13T01:25:50.190132+0000","last_fullsized":"2026-02-13T01:25:50.190132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190421+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:50.190421+0000","last_peered":"2026-02-13T01:25:50.190421+0000","last_clean":"2026-02-13T01:25:50.190421+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:50.190421+0000","last_undegraded":"2026-02-13T01:25:50.190421+0000","last_fullsized":"2026-02-13T01:25:50.190421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.626144+0000","last_change":"2026-02-13T01:25:50.191627+0000","last_active":"2026-02-13T01:25:50.191627+0000","last_peered":"2026-02-13T01:25:37.626144+0000","last_clean":"2026-02-13T01:25:37.626144+0000","last_became_active":"2026-02-13T01:25:36.136618+0000","last_became_peered":"2026-02-13T01:25:36.136618+0000","last_unstale":"2026-02-13T01:25:37.626144+0000","last_undegraded":"2026-02-13T01:25:37.626144+0000","last_fullsized":"2026-02-13T01:25:37.626144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,8,9],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189000+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:50.189000+0000","last_peered":"2026-02-13T01:25:50.189000+0000","last_clean":"2026-02-13T01:25:50.189000+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:50.189000+0000","last_undegraded":"2026-02-13T01:25:50.189000+0000","last_fullsized":"2026-02-13T01:25:50.189000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191666+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:50.191666+0000","last_peered":"2026-02-13T01:25:50.191666+0000","last_clean":"2026-02-13T01:25:50.191666+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:50.191666+0000","last_undegraded":"2026-02-13T01:25:50.191666+0000","last_fullsized":"2026-02-13T01:25:50.191666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191044+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:50.191044+0000","last_peered":"2026-02-13T01:25:50.191044+0000","last_clean":"2026-02-13T01:25:50.191044+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:50.191044+0000","last_undegraded":"2026-02-13T01:25:50.191044+0000","last_fullsized":"2026-02-13T01:25:50.191044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190973+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:50.190973+0000","last_peered":"2026-02-13T01:25:50.190973+0000","last_clean":"2026-02-13T01:25:50.190973+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:50.190973+0000","last_undegraded":"2026-02-13T01:25:50.190973+0000","last_fullsized":"2026-02-13T01:25:50.190973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191453+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:50.191453+0000","last_peered":"2026-02-13T01:25:50.191453+0000","last_clean":"2026-02-13T01:25:50.191453+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:50.191453+0000","last_undegraded":"2026-02-13T01:25:50.191453+0000","last_fullsized":"2026-02-13T01:25:50.191453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195170+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:50.195170+0000","last_peered":"2026-02-13T01:25:50.195170+0000","last_clean":"2026-02-13T01:25:50.195170+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:50.195170+0000","last_undegraded":"2026-02-13T01:25:50.195170+0000","last_fullsized":"2026-02-13T01:25:50.195170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191548+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:50.191548+0000","last_peered":"2026-02-13T01:25:50.191548+0000","last_clean":"2026-02-13T01:25:50.191548+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:50.191548+0000","last_undegraded":"2026-02-13T01:25:50.191548+0000","last_fullsized":"2026-02-13T01:25:50.191548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191112+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:50.191112+0000","last_peered":"2026-02-13T01:25:50.191112+0000","last_clean":"2026-02-13T01:25:50.191112+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:50.191112+0000","last_undegraded":"2026-02-13T01:25:50.191112+0000","last_fullsized":"2026-02-13T01:25:50.191112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190406+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:50.190406+0000","last_peered":"2026-02-13T01:25:50.190406+0000","last_clean":"2026-02-13T01:25:50.190406+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:50.190406+0000","last_undegraded":"2026-02-13T01:25:50.190406+0000","last_fullsized":"2026-02-13T01:25:50.190406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190283+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:50.190283+0000","last_peered":"2026-02-13T01:25:50.190283+0000","last_clean":"2026-02-13T01:25:50.190283+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:50.190283+0000","last_undegraded":"2026-02-13T01:25:50.190283+0000","last_fullsized":"2026-02-13T01:25:50.190283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195784+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:50.195784+0000","last_peered":"2026-02-13T01:25:50.195784+0000","last_clean":"2026-02-13T01:25:50.195784+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:50.195784+0000","last_undegraded":"2026-02-13T01:25:50.195784+0000","last_fullsized":"2026-02-13T01:25:50.195784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198259+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:51.198259+0000","last_peered":"2026-02-13T01:25:51.198259+0000","last_clean":"2026-02-13T01:25:51.198259+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:51.198259+0000","last_undegraded":"2026-02-13T01:25:51.198259+0000","last_fullsized":"2026-02-13T01:25:51.198259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190175+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:50.190175+0000","last_peered":"2026-02-13T01:25:50.190175+0000","last_clean":"2026-02-13T01:25:50.190175+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:50.190175+0000","last_undegraded":"2026-02-13T01:25:50.190175+0000","last_fullsized":"2026-02-13T01:25:50.190175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195194+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:50.195194+0000","last_peered":"2026-02-13T01:25:50.195194+0000","last_clean":"2026-02-13T01:25:50.195194+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:50.195194+0000","last_undegraded":"2026-02-13T01:25:50.195194+0000","last_fullsized":"2026-02-13T01:25:50.195194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190569+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:50.190569+0000","last_peered":"2026-02-13T01:25:50.190569+0000","last_clean":"2026-02-13T01:25:50.190569+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:50.190569+0000","last_undegraded":"2026-02-13T01:25:50.190569+0000","last_fullsized":"2026-02-13T01:25:50.190569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189227+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:50.189227+0000","last_peered":"2026-02-13T01:25:50.189227+0000","last_clean":"2026-02-13T01:25:50.189227+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:50.189227+0000","last_undegraded":"2026-02-13T01:25:50.189227+0000","last_fullsized":"2026-02-13T01:25:50.189227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190325+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:50.190325+0000","last_peered":"2026-02-13T01:25:50.190325+0000","last_clean":"2026-02-13T01:25:50.190325+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:50.190325+0000","last_undegraded":"2026-02-13T01:25:50.190325+0000","last_fullsized":"2026-02-13T01:25:50.190325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189857+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:50.189857+0000","last_peered":"2026-02-13T01:25:50.189857+0000","last_clean":"2026-02-13T01:25:50.189857+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:50.189857+0000","last_undegraded":"2026-02-13T01:25:50.189857+0000","last_fullsized":"2026-02-13T01:25:50.189857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198417+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:51.198417+0000","last_peered":"2026-02-13T01:25:51.198417+0000","last_clean":"2026-02-13T01:25:51.198417+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:51.198417+0000","last_undegraded":"2026-02-13T01:25:51.198417+0000","last_fullsized":"2026-02-13T01:25:51.198417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190053+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:50.190053+0000","last_peered":"2026-02-13T01:25:50.190053+0000","last_clean":"2026-02-13T01:25:50.190053+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:50.190053+0000","last_undegraded":"2026-02-13T01:25:50.190053+0000","last_fullsized":"2026-02-13T01:25:50.190053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195318+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:50.195318+0000","last_peered":"2026-02-13T01:25:50.195318+0000","last_clean":"2026-02-13T01:25:50.195318+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:50.195318+0000","last_undegraded":"2026-02-13T01:25:50.195318+0000","last_fullsized":"2026-02-13T01:25:50.195318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191704+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:50.191704+0000","last_peered":"2026-02-13T01:25:50.191704+0000","last_clean":"2026-02-13T01:25:50.191704+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:50.191704+0000","last_undegraded":"2026-02-13T01:25:50.191704+0000","last_fullsized":"2026-02-13T01:25:50.191704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198114+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:51.198114+0000","last_peered":"2026-02-13T01:25:51.198114+0000","last_clean":"2026-02-13T01:25:51.198114+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:51.198114+0000","last_undegraded":"2026-02-13T01:25:51.198114+0000","last_fullsized":"2026-02-13T01:25:51.198114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198181+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:51.198181+0000","last_peered":"2026-02-13T01:25:51.198181+0000","last_clean":"2026-02-13T01:25:51.198181+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:51.198181+0000","last_undegraded":"2026-02-13T01:25:51.198181+0000","last_fullsized":"2026-02-13T01:25:51.198181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190078+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:50.190078+0000","last_peered":"2026-02-13T01:25:50.190078+0000","last_clean":"2026-02-13T01:25:50.190078+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:50.190078+0000","last_undegraded":"2026-02-13T01:25:50.190078+0000","last_fullsized":"2026-02-13T01:25:50.190078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190440+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:50.190440+0000","last_peered":"2026-02-13T01:25:50.190440+0000","last_clean":"2026-02-13T01:25:50.190440+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:50.190440+0000","last_undegraded":"2026-02-13T01:25:50.190440+0000","last_fullsized":"2026-02-13T01:25:50.190440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190437+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:50.190437+0000","last_peered":"2026-02-13T01:25:50.190437+0000","last_clean":"2026-02-13T01:25:50.190437+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:50.190437+0000","last_undegraded":"2026-02-13T01:25:50.190437+0000","last_fullsized":"2026-02-13T01:25:50.190437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.747845+0000","last_change":"2026-02-13T01:25:50.190840+0000","last_active":"2026-02-13T01:25:50.190840+0000","last_peered":"2026-02-13T01:25:38.747845+0000","last_clean":"2026-02-13T01:25:38.747845+0000","last_became_active":"2026-02-13T01:25:36.141933+0000","last_became_peered":"2026-02-13T01:25:36.141933+0000","last_unstale":"2026-02-13T01:25:38.747845+0000","last_undegraded":"2026-02-13T01:25:38.747845+0000","last_fullsized":"2026-02-13T01:25:38.747845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190556+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:50.190556+0000","last_peered":"2026-02-13T01:25:50.190556+0000","last_clean":"2026-02-13T01:25:50.190556+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:50.190556+0000","last_undegraded":"2026-02-13T01:25:50.190556+0000","last_fullsized":"2026-02-13T01:25:50.190556+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194232+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:50.194232+0000","last_peered":"2026-02-13T01:25:50.194232+0000","last_clean":"2026-02-13T01:25:50.194232+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:50.194232+0000","last_undegraded":"2026-02-13T01:25:50.194232+0000","last_fullsized":"2026-02-13T01:25:50.194232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189282+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:50.189282+0000","last_peered":"2026-02-13T01:25:50.189282+0000","last_clean":"2026-02-13T01:25:50.189282+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:50.189282+0000","last_undegraded":"2026-02-13T01:25:50.189282+0000","last_fullsized":"2026-02-13T01:25:50.189282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190696+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:50.190696+0000","last_peered":"2026-02-13T01:25:50.190696+0000","last_clean":"2026-02-13T01:25:50.190696+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:50.190696+0000","last_undegraded":"2026-02-13T01:25:50.190696+0000","last_fullsized":"2026-02-13T01:25:50.190696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.817516+0000","last_change":"2026-02-13T01:25:50.193701+0000","last_active":"2026-02-13T01:25:50.193701+0000","last_peered":"2026-02-13T01:25:39.817516+0000","last_clean":"2026-02-13T01:25:39.817516+0000","last_became_active":"2026-02-13T01:25:36.146372+0000","last_became_peered":"2026-02-13T01:25:36.146372+0000","last_unstale":"2026-02-13T01:25:39.817516+0000","last_undegraded":"2026-02-13T01:25:39.817516+0000","last_fullsized":"2026-02-13T01:25:39.817516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6,10],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191214+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:50.191214+0000","last_peered":"2026-02-13T01:25:50.191214+0000","last_clean":"2026-02-13T01:25:50.191214+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:50.191214+0000","last_undegraded":"2026-02-13T01:25:50.191214+0000","last_fullsized":"2026-02-13T01:25:50.191214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191488+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:50.191488+0000","last_peered":"2026-02-13T01:25:50.191488+0000","last_clean":"2026-02-13T01:25:50.191488+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:50.191488+0000","last_undegraded":"2026-02-13T01:25:50.191488+0000","last_fullsized":"2026-02-13T01:25:50.191488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190950+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:50.190950+0000","last_peered":"2026-02-13T01:25:50.190950+0000","last_clean":"2026-02-13T01:25:50.190950+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:50.190950+0000","last_undegraded":"2026-02-13T01:25:50.190950+0000","last_fullsized":"2026-02-13T01:25:50.190950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.790444+0000","last_change":"2026-02-13T01:25:50.189819+0000","last_active":"2026-02-13T01:25:50.189819+0000","last_peered":"2026-02-13T01:25:37.790444+0000","last_clean":"2026-02-13T01:25:37.790444+0000","last_became_active":"2026-02-13T01:25:36.141935+0000","last_became_peered":"2026-02-13T01:25:36.141935+0000","last_unstale":"2026-02-13T01:25:37.790444+0000","last_undegraded":"2026-02-13T01:25:37.790444+0000","last_fullsized":"2026-02-13T01:25:37.790444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190786+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:50.190786+0000","last_peered":"2026-02-13T01:25:50.190786+0000","last_clean":"2026-02-13T01:25:50.190786+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:50.190786+0000","last_undegraded":"2026-02-13T01:25:50.190786+0000","last_fullsized":"2026-02-13T01:25:50.190786+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191348+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:50.191348+0000","last_peered":"2026-02-13T01:25:50.191348+0000","last_clean":"2026-02-13T01:25:50.191348+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:50.191348+0000","last_undegraded":"2026-02-13T01:25:50.191348+0000","last_fullsized":"2026-02-13T01:25:50.191348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'23","reported_seq":67,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191048+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:50.191048+0000","last_peered":"2026-02-13T01:25:50.191048+0000","last_clean":"2026-02-13T01:25:50.191048+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:50.191048+0000","last_undegraded":"2026-02-13T01:25:50.191048+0000","last_fullsized":"2026-02-13T01:25:50.191048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54876,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":65,"num_write":24,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190236+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:50.190236+0000","last_peered":"2026-02-13T01:25:50.190236+0000","last_clean":"2026-02-13T01:25:50.190236+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:50.190236+0000","last_undegraded":"2026-02-13T01:25:50.190236+0000","last_fullsized":"2026-02-13T01:25:50.190236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198199+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:51.198199+0000","last_peered":"2026-02-13T01:25:51.198199+0000","last_clean":"2026-02-13T01:25:51.198199+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:51.198199+0000","last_undegraded":"2026-02-13T01:25:51.198199+0000","last_fullsized":"2026-02-13T01:25:51.198199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194241+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:50.194241+0000","last_peered":"2026-02-13T01:25:50.194241+0000","last_clean":"2026-02-13T01:25:50.194241+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:50.194241+0000","last_undegraded":"2026-02-13T01:25:50.194241+0000","last_fullsized":"2026-02-13T01:25:50.194241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190320+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:50.190320+0000","last_peered":"2026-02-13T01:25:50.190320+0000","last_clean":"2026-02-13T01:25:50.190320+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:50.190320+0000","last_undegraded":"2026-02-13T01:25:50.190320+0000","last_fullsized":"2026-02-13T01:25:50.190320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191360+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:50.191360+0000","last_peered":"2026-02-13T01:25:50.191360+0000","last_clean":"2026-02-13T01:25:50.191360+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:50.191360+0000","last_undegraded":"2026-02-13T01:25:50.191360+0000","last_fullsized":"2026-02-13T01:25:50.191360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190813+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:50.190813+0000","last_peered":"2026-02-13T01:25:50.190813+0000","last_clean":"2026-02-13T01:25:50.190813+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:50.190813+0000","last_undegraded":"2026-02-13T01:25:50.190813+0000","last_fullsized":"2026-02-13T01:25:50.190813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190863+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:50.190863+0000","last_peered":"2026-02-13T01:25:50.190863+0000","last_clean":"2026-02-13T01:25:50.190863+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:50.190863+0000","last_undegraded":"2026-02-13T01:25:50.190863+0000","last_fullsized":"2026-02-13T01:25:50.190863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190084+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:50.190084+0000","last_peered":"2026-02-13T01:25:50.190084+0000","last_clean":"2026-02-13T01:25:50.190084+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:50.190084+0000","last_undegraded":"2026-02-13T01:25:50.190084+0000","last_fullsized":"2026-02-13T01:25:50.190084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190238+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:50.190238+0000","last_peered":"2026-02-13T01:25:50.190238+0000","last_clean":"2026-02-13T01:25:50.190238+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:50.190238+0000","last_undegraded":"2026-02-13T01:25:50.190238+0000","last_fullsized":"2026-02-13T01:25:50.190238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190292+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:50.190292+0000","last_peered":"2026-02-13T01:25:50.190292+0000","last_clean":"2026-02-13T01:25:50.190292+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:50.190292+0000","last_undegraded":"2026-02-13T01:25:50.190292+0000","last_fullsized":"2026-02-13T01:25:50.190292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.889644+0000","last_change":"2026-02-13T01:25:50.190333+0000","last_active":"2026-02-13T01:25:50.190333+0000","last_peered":"2026-02-13T01:25:39.889644+0000","last_clean":"2026-02-13T01:25:39.889644+0000","last_became_active":"2026-02-13T01:25:36.138102+0000","last_became_peered":"2026-02-13T01:25:36.138102+0000","last_unstale":"2026-02-13T01:25:39.889644+0000","last_undegraded":"2026-02-13T01:25:39.889644+0000","last_fullsized":"2026-02-13T01:25:39.889644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195305+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:50.195305+0000","last_peered":"2026-02-13T01:25:50.195305+0000","last_clean":"2026-02-13T01:25:50.195305+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:50.195305+0000","last_undegraded":"2026-02-13T01:25:50.195305+0000","last_fullsized":"2026-02-13T01:25:50.195305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191659+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:50.191659+0000","last_peered":"2026-02-13T01:25:50.191659+0000","last_clean":"2026-02-13T01:25:50.191659+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:50.191659+0000","last_undegraded":"2026-02-13T01:25:50.191659+0000","last_fullsized":"2026-02-13T01:25:50.191659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190958+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:50.190958+0000","last_peered":"2026-02-13T01:25:50.190958+0000","last_clean":"2026-02-13T01:25:50.190958+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:50.190958+0000","last_undegraded":"2026-02-13T01:25:50.190958+0000","last_fullsized":"2026-02-13T01:25:50.190958+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":16,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:43.404136+0000","last_change":"2026-02-13T01:25:50.191853+0000","last_active":"2026-02-13T01:25:50.191853+0000","last_peered":"2026-02-13T01:25:43.404136+0000","last_clean":"2026-02-13T01:25:43.404136+0000","last_became_active":"2026-02-13T01:25:36.140854+0000","last_became_peered":"2026-02-13T01:25:36.140854+0000","last_unstale":"2026-02-13T01:25:43.404136+0000","last_undegraded":"2026-02-13T01:25:43.404136+0000","last_fullsized":"2026-02-13T01:25:43.404136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5,8],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198298+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:51.198298+0000","last_peered":"2026-02-13T01:25:51.198298+0000","last_clean":"2026-02-13T01:25:51.198298+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:51.198298+0000","last_undegraded":"2026-02-13T01:25:51.198298+0000","last_fullsized":"2026-02-13T01:25:51.198298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":341,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191117+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:50.191117+0000","last_peered":"2026-02-13T01:25:50.191117+0000","last_clean":"2026-02-13T01:25:50.191117+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:50.191117+0000","last_undegraded":"2026-02-13T01:25:50.191117+0000","last_fullsized":"2026-02-13T01:25:50.191117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191819+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:50.191819+0000","last_peered":"2026-02-13T01:25:50.191819+0000","last_clean":"2026-02-13T01:25:50.191819+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:50.191819+0000","last_undegraded":"2026-02-13T01:25:50.191819+0000","last_fullsized":"2026-02-13T01:25:50.191819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.188635+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:50.188635+0000","last_peered":"2026-02-13T01:25:50.188635+0000","last_clean":"2026-02-13T01:25:50.188635+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:50.188635+0000","last_undegraded":"2026-02-13T01:25:50.188635+0000","last_fullsized":"2026-02-13T01:25:50.188635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191028+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:50.191028+0000","last_peered":"2026-02-13T01:25:50.191028+0000","last_clean":"2026-02-13T01:25:50.191028+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:50.191028+0000","last_undegraded":"2026-02-13T01:25:50.191028+0000","last_fullsized":"2026-02-13T01:25:50.191028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194191+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:50.194191+0000","last_peered":"2026-02-13T01:25:50.194191+0000","last_clean":"2026-02-13T01:25:50.194191+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:50.194191+0000","last_undegraded":"2026-02-13T01:25:50.194191+0000","last_fullsized":"2026-02-13T01:25:50.194191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.194250+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:50.194250+0000","last_peered":"2026-02-13T01:25:50.194250+0000","last_clean":"2026-02-13T01:25:50.194250+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:50.194250+0000","last_undegraded":"2026-02-13T01:25:50.194250+0000","last_fullsized":"2026-02-13T01:25:50.194250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.747807+0000","last_change":"2026-02-13T01:25:50.191189+0000","last_active":"2026-02-13T01:25:50.191189+0000","last_peered":"2026-02-13T01:25:38.747807+0000","last_clean":"2026-02-13T01:25:38.747807+0000","last_became_active":"2026-02-13T01:25:36.138947+0000","last_became_peered":"2026-02-13T01:25:36.138947+0000","last_unstale":"2026-02-13T01:25:38.747807+0000","last_undegraded":"2026-02-13T01:25:38.747807+0000","last_fullsized":"2026-02-13T01:25:38.747807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190745+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:50.190745+0000","last_peered":"2026-02-13T01:25:50.190745+0000","last_clean":"2026-02-13T01:25:50.190745+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:50.190745+0000","last_undegraded":"2026-02-13T01:25:50.190745+0000","last_fullsized":"2026-02-13T01:25:50.190745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195371+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:50.195371+0000","last_peered":"2026-02-13T01:25:50.195371+0000","last_clean":"2026-02-13T01:25:50.195371+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:50.195371+0000","last_undegraded":"2026-02-13T01:25:50.195371+0000","last_fullsized":"2026-02-13T01:25:50.195371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191183+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:50.191183+0000","last_peered":"2026-02-13T01:25:50.191183+0000","last_clean":"2026-02-13T01:25:50.191183+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:50.191183+0000","last_undegraded":"2026-02-13T01:25:50.191183+0000","last_fullsized":"2026-02-13T01:25:50.191183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190447+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:50.190447+0000","last_peered":"2026-02-13T01:25:50.190447+0000","last_clean":"2026-02-13T01:25:50.190447+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:50.190447+0000","last_undegraded":"2026-02-13T01:25:50.190447+0000","last_fullsized":"2026-02-13T01:25:50.190447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195342+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:50.195342+0000","last_peered":"2026-02-13T01:25:50.195342+0000","last_clean":"2026-02-13T01:25:50.195342+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:50.195342+0000","last_undegraded":"2026-02-13T01:25:50.195342+0000","last_fullsized":"2026-02-13T01:25:50.195342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195820+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:50.195820+0000","last_peered":"2026-02-13T01:25:50.195820+0000","last_clean":"2026-02-13T01:25:50.195820+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:50.195820+0000","last_undegraded":"2026-02-13T01:25:50.195820+0000","last_fullsized":"2026-02-13T01:25:50.195820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189892+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:50.189892+0000","last_peered":"2026-02-13T01:25:50.189892+0000","last_clean":"2026-02-13T01:25:50.189892+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:50.189892+0000","last_undegraded":"2026-02-13T01:25:50.189892+0000","last_fullsized":"2026-02-13T01:25:50.189892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191449+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:50.191449+0000","last_peered":"2026-02-13T01:25:50.191449+0000","last_clean":"2026-02-13T01:25:50.191449+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:50.191449+0000","last_undegraded":"2026-02-13T01:25:50.191449+0000","last_fullsized":"2026-02-13T01:25:50.191449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191935+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:50.191935+0000","last_peered":"2026-02-13T01:25:50.191935+0000","last_clean":"2026-02-13T01:25:50.191935+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:50.191935+0000","last_undegraded":"2026-02-13T01:25:50.191935+0000","last_fullsized":"2026-02-13T01:25:50.191935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.865000+0000","last_change":"2026-02-13T01:25:50.190866+0000","last_active":"2026-02-13T01:25:50.190866+0000","last_peered":"2026-02-13T01:25:38.865000+0000","last_clean":"2026-02-13T01:25:38.865000+0000","last_became_active":"2026-02-13T01:25:35.141256+0000","last_became_peered":"2026-02-13T01:25:35.141256+0000","last_unstale":"2026-02-13T01:25:38.865000+0000","last_undegraded":"2026-02-13T01:25:38.865000+0000","last_fullsized":"2026-02-13T01:25:38.865000+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190130+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:50.190130+0000","last_peered":"2026-02-13T01:25:50.190130+0000","last_clean":"2026-02-13T01:25:50.190130+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:50.190130+0000","last_undegraded":"2026-02-13T01:25:50.190130+0000","last_fullsized":"2026-02-13T01:25:50.190130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189254+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:50.189254+0000","last_peered":"2026-02-13T01:25:50.189254+0000","last_clean":"2026-02-13T01:25:50.189254+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:50.189254+0000","last_undegraded":"2026-02-13T01:25:50.189254+0000","last_fullsized":"2026-02-13T01:25:50.189254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190396+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:50.190396+0000","last_peered":"2026-02-13T01:25:50.190396+0000","last_clean":"2026-02-13T01:25:50.190396+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:50.190396+0000","last_undegraded":"2026-02-13T01:25:50.190396+0000","last_fullsized":"2026-02-13T01:25:50.190396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198130+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:51.198130+0000","last_peered":"2026-02-13T01:25:51.198130+0000","last_clean":"2026-02-13T01:25:51.198130+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:51.198130+0000","last_undegraded":"2026-02-13T01:25:51.198130+0000","last_fullsized":"2026-02-13T01:25:51.198130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189695+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:50.189695+0000","last_peered":"2026-02-13T01:25:50.189695+0000","last_clean":"2026-02-13T01:25:50.189695+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:50.189695+0000","last_undegraded":"2026-02-13T01:25:50.189695+0000","last_fullsized":"2026-02-13T01:25:50.189695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190150+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:50.190150+0000","last_peered":"2026-02-13T01:25:50.190150+0000","last_clean":"2026-02-13T01:25:50.190150+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:50.190150+0000","last_undegraded":"2026-02-13T01:25:50.190150+0000","last_fullsized":"2026-02-13T01:25:50.190150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191207+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:50.191207+0000","last_peered":"2026-02-13T01:25:50.191207+0000","last_clean":"2026-02-13T01:25:50.191207+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:50.191207+0000","last_undegraded":"2026-02-13T01:25:50.191207+0000","last_fullsized":"2026-02-13T01:25:50.191207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190787+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:50.190787+0000","last_peered":"2026-02-13T01:25:50.190787+0000","last_clean":"2026-02-13T01:25:50.190787+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:50.190787+0000","last_undegraded":"2026-02-13T01:25:50.190787+0000","last_fullsized":"2026-02-13T01:25:50.190787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190250+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:50.190250+0000","last_peered":"2026-02-13T01:25:50.190250+0000","last_clean":"2026-02-13T01:25:50.190250+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:50.190250+0000","last_undegraded":"2026-02-13T01:25:50.190250+0000","last_fullsized":"2026-02-13T01:25:50.190250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191230+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:50.191230+0000","last_peered":"2026-02-13T01:25:50.191230+0000","last_clean":"2026-02-13T01:25:50.191230+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:50.191230+0000","last_undegraded":"2026-02-13T01:25:50.191230+0000","last_fullsized":"2026-02-13T01:25:50.191230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:38.432332+0000","last_change":"2026-02-13T01:25:50.570263+0000","last_active":"2026-02-13T01:25:50.570263+0000","last_peered":"2026-02-13T01:25:38.432332+0000","last_clean":"2026-02-13T01:25:38.432332+0000","last_became_active":"2026-02-13T01:25:35.134066+0000","last_became_peered":"2026-02-13T01:25:35.134066+0000","last_unstale":"2026-02-13T01:25:38.432332+0000","last_undegraded":"2026-02-13T01:25:38.432332+0000","last_fullsized":"2026-02-13T01:25:38.432332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190708+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:50.190708+0000","last_peered":"2026-02-13T01:25:50.190708+0000","last_clean":"2026-02-13T01:25:50.190708+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:50.190708+0000","last_undegraded":"2026-02-13T01:25:50.190708+0000","last_fullsized":"2026-02-13T01:25:50.190708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.189166+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:50.189166+0000","last_peered":"2026-02-13T01:25:50.189166+0000","last_clean":"2026-02-13T01:25:50.189166+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:50.189166+0000","last_undegraded":"2026-02-13T01:25:50.189166+0000","last_fullsized":"2026-02-13T01:25:50.189166+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:36.137991+0000","last_change":"2026-02-13T01:25:50.461647+0000","last_active":"2026-02-13T01:25:50.461647+0000","last_peered":"2026-02-13T01:25:35.123396+0000","last_clean":"2026-02-13T01:25:35.123396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-13T01:25:36.137991+0000","last_undegraded":"2026-02-13T01:25:36.137991+0000","last_fullsized":"2026-02-13T01:25:36.137991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195664+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:50.195664+0000","last_peered":"2026-02-13T01:25:50.195664+0000","last_clean":"2026-02-13T01:25:50.195664+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:50.195664+0000","last_undegraded":"2026-02-13T01:25:50.195664+0000","last_fullsized":"2026-02-13T01:25:50.195664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58962,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":85,"num_read_kb":104,"num_write":153,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":176886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153448,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":389920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6660,"internal_metadata":27583996},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939658,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27892,"kb_used_data":928,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975308,"statfs":{"total":751619276800,"available":751590715392,"internally_reserved":0,"allocated":950272,"data_stored":1027735,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25621,"internal_metadata":27565035},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32377,"internal_metadata":27558279},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":982025,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19535,"internal_metadata":27571121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":389523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27743,"internal_metadata":27562913},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920788,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":981709,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33384,"internal_metadata":27557272},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051605,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":381418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40761,"internal_metadata":27549895},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280534,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":389834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49165,"internal_metadata":27541491},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":445974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59562,"internal_metadata":27531094},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":444192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771099,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":390838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46671,"internal_metadata":27543985},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2299,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33504,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30263,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11057,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2790,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8230,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20472,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12916,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23697,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2424,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:54.465 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.39 is not active+clean 2026-02-13T01:25:54.465 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:37.626144+0000', 'last_change': '2026-02-13T01:25:50.191627+0000', 'last_active': '2026-02-13T01:25:50.191627+0000', 'last_peered': '2026-02-13T01:25:37.626144+0000', 'last_clean': '2026-02-13T01:25:37.626144+0000', 'last_became_active': '2026-02-13T01:25:36.136618+0000', 'last_became_peered': '2026-02-13T01:25:36.136618+0000', 'last_unstale': '2026-02-13T01:25:37.626144+0000', 'last_undegraded': '2026-02-13T01:25:37.626144+0000', 'last_fullsized': '2026-02-13T01:25:37.626144+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 9, 8], 'acting': [7, 9, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5, 8, 9], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1b is not active+clean 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:38.747845+0000', 'last_change': '2026-02-13T01:25:50.190840+0000', 'last_active': '2026-02-13T01:25:50.190840+0000', 'last_peered': '2026-02-13T01:25:38.747845+0000', 'last_clean': '2026-02-13T01:25:38.747845+0000', 'last_became_active': '2026-02-13T01:25:36.141933+0000', 'last_became_peered': '2026-02-13T01:25:36.141933+0000', 'last_unstale': '2026-02-13T01:25:38.747845+0000', 'last_undegraded': '2026-02-13T01:25:38.747845+0000', 'last_fullsized': '2026-02-13T01:25:38.747845+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7, 3], 'acting': [5, 7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 4, 7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.19 is not active+clean 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:39.817516+0000', 'last_change': '2026-02-13T01:25:50.193701+0000', 'last_active': '2026-02-13T01:25:50.193701+0000', 'last_peered': '2026-02-13T01:25:39.817516+0000', 'last_clean': '2026-02-13T01:25:39.817516+0000', 'last_became_active': '2026-02-13T01:25:36.146372+0000', 'last_became_peered': '2026-02-13T01:25:36.146372+0000', 'last_unstale': '2026-02-13T01:25:39.817516+0000', 'last_undegraded': '2026-02-13T01:25:39.817516+0000', 'last_fullsized': '2026-02-13T01:25:39.817516+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 6, 10], 'acting': [9, 6, 10], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 6, 10], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.17 is not active+clean 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:37.790444+0000', 'last_change': '2026-02-13T01:25:50.189819+0000', 'last_active': '2026-02-13T01:25:50.189819+0000', 'last_peered': '2026-02-13T01:25:37.790444+0000', 'last_clean': '2026-02-13T01:25:37.790444+0000', 'last_became_active': '2026-02-13T01:25:36.141935+0000', 'last_became_peered': '2026-02-13T01:25:36.141935+0000', 'last_unstale': '2026-02-13T01:25:37.790444+0000', 'last_undegraded': '2026-02-13T01:25:37.790444+0000', 'last_fullsized': '2026-02-13T01:25:37.790444+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 8, 5], 'acting': [0, 8, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 5, 8], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2026-02-13T01:25:54.466 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.e is not active+clean 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:39.889644+0000', 'last_change': '2026-02-13T01:25:50.190333+0000', 'last_active': '2026-02-13T01:25:50.190333+0000', 'last_peered': '2026-02-13T01:25:39.889644+0000', 'last_clean': '2026-02-13T01:25:39.889644+0000', 'last_became_active': '2026-02-13T01:25:36.138102+0000', 'last_became_peered': '2026-02-13T01:25:36.138102+0000', 'last_unstale': '2026-02-13T01:25:39.889644+0000', 'last_undegraded': '2026-02-13T01:25:39.889644+0000', 'last_fullsized': '2026-02-13T01:25:39.889644+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 5, 7], 'acting': [11, 5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 5, 7], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.c is not active+clean 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.c', 'version': "75'1", 'reported_seq': 16, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:43.404136+0000', 'last_change': '2026-02-13T01:25:50.191853+0000', 'last_active': '2026-02-13T01:25:50.191853+0000', 'last_peered': '2026-02-13T01:25:43.404136+0000', 'last_clean': '2026-02-13T01:25:43.404136+0000', 'last_became_active': '2026-02-13T01:25:36.140854+0000', 'last_became_peered': '2026-02-13T01:25:36.140854+0000', 'last_unstale': '2026-02-13T01:25:43.404136+0000', 'last_undegraded': '2026-02-13T01:25:43.404136+0000', 'last_fullsized': '2026-02-13T01:25:43.404136+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 117, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 1, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3, 8], 'acting': [7, 3, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 5, 8], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.0 is not active+clean 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:38.747807+0000', 'last_change': '2026-02-13T01:25:50.191189+0000', 'last_active': '2026-02-13T01:25:50.191189+0000', 'last_peered': '2026-02-13T01:25:38.747807+0000', 'last_clean': '2026-02-13T01:25:38.747807+0000', 'last_became_active': '2026-02-13T01:25:36.138947+0000', 'last_became_peered': '2026-02-13T01:25:36.138947+0000', 'last_unstale': '2026-02-13T01:25:38.747807+0000', 'last_undegraded': '2026-02-13T01:25:38.747807+0000', 'last_fullsized': '2026-02-13T01:25:38.747807+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2, 6], 'acting': [5, 2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.8 is not active+clean 2026-02-13T01:25:54.467 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.8', 'version': "75'2", 'reported_seq': 19, 'reported_epoch': 75, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:38.865000+0000', 'last_change': '2026-02-13T01:25:50.190866+0000', 'last_active': '2026-02-13T01:25:50.190866+0000', 'last_peered': '2026-02-13T01:25:38.865000+0000', 'last_clean': '2026-02-13T01:25:38.865000+0000', 'last_became_active': '2026-02-13T01:25:35.141256+0000', 'last_became_peered': '2026-02-13T01:25:35.141256+0000', 'last_unstale': '2026-02-13T01:25:38.865000+0000', 'last_undegraded': '2026-02-13T01:25:38.865000+0000', 'last_fullsized': '2026-02-13T01:25:38.865000+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 73, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:34.121854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:34.121854+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:34.121854+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 3, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 11, 0], 'acting': [1, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 2, 11], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-13T01:25:54.468 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.1d is not active+clean 2026-02-13T01:25:54.468 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.1d', 'version': "75'4", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:38.432332+0000', 'last_change': '2026-02-13T01:25:50.570263+0000', 'last_active': '2026-02-13T01:25:50.570263+0000', 'last_peered': '2026-02-13T01:25:38.432332+0000', 'last_clean': '2026-02-13T01:25:38.432332+0000', 'last_became_active': '2026-02-13T01:25:35.134066+0000', 'last_became_peered': '2026-02-13T01:25:35.134066+0000', 'last_unstale': '2026-02-13T01:25:38.432332+0000', 'last_undegraded': '2026-02-13T01:25:38.432332+0000', 'last_fullsized': '2026-02-13T01:25:38.432332+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 72, 'last_epoch_clean': 73, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:34.121854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:34.121854+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:34.121854+0000', 'objects_scrubbed': 0, 'log_size': 4, 'log_dups_size': 0, 'ondisk_log_size': 4, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 5, 'num_write_kb': 6, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 2, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 2, 7], 'acting': [11, 2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2026-02-13T01:25:54.468 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1e is not active+clean 2026-02-13T01:25:54.468 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 76, 'state': 'peering', 'last_fresh': '2026-02-13T01:25:36.137991+0000', 'last_change': '2026-02-13T01:25:50.461647+0000', 'last_active': '2026-02-13T01:25:50.461647+0000', 'last_peered': '2026-02-13T01:25:35.123396+0000', 'last_clean': '2026-02-13T01:25:35.123396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2026-02-13T01:25:36.137991+0000', 'last_undegraded': '2026-02-13T01:25:36.137991+0000', 'last_fullsized': '2026-02-13T01:25:36.137991+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'last_clean_scrub_stamp': '2026-02-13T01:25:35.123396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 2, 5], 'acting': [9, 2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-13T01:25:54.469 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph status --format=json 2026-02-13T01:25:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:54 trial134 ceph-mon[27948]: from='client.24865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:54.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:54 trial134 ceph-mon[27948]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:54.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:54 trial187 ceph-mon[27464]: from='client.24865 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:54.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:54 trial187 ceph-mon[27464]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:54.650 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:54.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/156236786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc10fa50 msgr2=0x7f8bcc114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/156236786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc10fa50 0x7f8bcc114a90 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=1950036270330770425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bbc0099a0 tx=0x7f8bbc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:54.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/156236786 shutdown_connections 2026-02-13T01:25:54.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/156236786 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8bcc115270 0x7f8bcc175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/156236786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc10fa50 0x7f8bcc114a90 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=1950036270330770425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/156236786 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc10f060 0x7f8bcc10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/156236786 >> 10.20.193.28:0/156236786 conn(0x7f8bcc0ec980 msgr2=0x7f8bcc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:54.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/156236786 shutdown_connections 2026-02-13T01:25:54.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.844+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/156236786 wait complete. 2026-02-13T01:25:54.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 Processor -- start 2026-02-13T01:25:54.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 -- start start 2026-02-13T01:25:54.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8bcc10f060 0x7f8bcc0f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 0x7f8bcc175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc0f4fc0 0x7f8bcc0fa290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0f56b0 con 0x7f8bcc115270 2026-02-13T01:25:54.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0fa7d0 con 0x7f8bcc10f060 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.845+0000 7f8bd0f276c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0fa990 con 0x7f8bcc0f4fc0 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 0x7f8bcc175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 0x7f8bcc175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57080/0 (socket says 10.20.193.28:57080) 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 -- 10.20.193.28:0/3152920974 learned_addr learned my addr 10.20.193.28:0/3152920974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcb7fe6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8bcc10f060 0x7f8bcc0f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcbfff6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc0f4fc0 0x7f8bcc0fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 -- 10.20.193.28:0/3152920974 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc0f4fc0 msgr2=0x7f8bcc0fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc0f4fc0 0x7f8bcc0fa290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 -- 10.20.193.28:0/3152920974 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8bcc10f060 msgr2=0x7f8bcc0f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8bcc10f060 0x7f8bcc0f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 -- 10.20.193.28:0/3152920974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80094c0 con 0x7f8bcc115270 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcbfff6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc0f4fc0 0x7f8bcc0fa290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bcaffd6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 0x7f8bcc175b10 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bbc031f90 tx=0x7f8bbc02f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bbc0028d0 con 0x7f8bcc115270 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bbc009590 con 0x7f8bcc115270 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8bbc007740 con 0x7f8bcc115270 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8bbc031600 con 0x7f8bcc115270 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.846+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc0faf50 con 0x7f8bcc115270 2026-02-13T01:25:54.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.847+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc110330 con 0x7f8bcc115270 2026-02-13T01:25:54.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.849+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f8bbc007260 con 0x7f8bcc115270 2026-02-13T01:25:54.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.851+0000 7f8bc8ff96c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8ba00b5710 0x7f8ba00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:54.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.851+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f8bbc107d50 con 0x7f8bcc115270 2026-02-13T01:25:54.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.851+0000 7f8bcb7fe6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8ba00b5710 0x7f8ba00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:54.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.851+0000 7f8bcb7fe6c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8ba00b5710 0x7f8ba00d5bc0 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bb8004750 tx=0x7f8bb8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:54.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.852+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8bbc0ca650 con 0x7f8bcc115270 2026-02-13T01:25:54.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.990+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8bcc0f5ae0 con 0x7f8bcc115270 2026-02-13T01:25:54.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.990+0000 7f8bc8ff96c0 1 -- 10.20.193.28:0/3152920974 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3700 (secure 0 0 0) 0x7f8bbc0cd800 con 0x7f8bcc115270 2026-02-13T01:25:54.991 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:54.991 INFO:teuthology.orchestra.run.trial028.stdout:{"fsid":"70ced355-087a-11f1-9708-d404e6e7d460","health":{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":153,"monmap":{"epoch":3,"min_mon_release_name":"tentacle","num_mons":3},"osdmap":{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1770945914,"num_in_osds":12,"osd_in_since":1770945906,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":64,"data_bytes":649564,"bytes_used":341594112,"bytes_avail":9019089727488,"bytes_total":9019431321600,"inactive_pgs_ratio":0.10309278219938278,"read_bytes_sec":9725,"write_bytes_sec":4862,"read_op_per_sec":7,"write_op_per_sec":3},"fsmap":{"epoch":21,"btime":"2026-02-13T01:25:40:869974+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"j","status":"up:standby-replay","gid":24538},{"filesystem_id":1,"rank":1,"name":"h","status":"up:standby-replay","gid":24548},{"filesystem_id":1,"rank":0,"name":"f","status":"up:standby-replay","gid":24562},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24568},{"filesystem_id":1,"rank":1,"name":"b","status":"up:active","gid":24578},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24583}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","iostat","nfs"],"services":{}},"servicemap":{"epoch":14,"modified":"2026-02-13T01:25:48.701146+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","10":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"11":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"9":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2026-02-13T01:25:54.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8ba00b5710 msgr2=0x7f8ba00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8ba00b5710 0x7f8ba00d5bc0 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bb8004750 tx=0x7f8bb8009260 comp rx=0 tx=0).stop 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 msgr2=0x7f8bcc175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 0x7f8bcc175b10 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8bbc031f90 tx=0x7f8bbc02f9f0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 shutdown_connections 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8ba00b5710 0x7f8ba00d5bc0 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8bcc0f4fc0 0x7f8bcc0fa290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc115270 0x7f8bcc175b10 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 --2- 10.20.193.28:0/3152920974 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8bcc10f060 0x7f8bcc0f4990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 >> 10.20.193.28:0/3152920974 conn(0x7f8bcc0ec980 msgr2=0x7f8bcc10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 shutdown_connections 2026-02-13T01:25:54.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:54.991+0000 7f8bd0f276c0 1 -- 10.20.193.28:0/3152920974 wait complete. 2026-02-13T01:25:55.096 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-13T01:25:55.096 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:55.277 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:55.322 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:55 trial028 ceph-mon[22984]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:55.323 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:55 trial028 ceph-mon[22984]: pgmap v207: 97 pgs: 7 peering, 90 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2026-02-13T01:25:55.323 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:55 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3152920974' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-13T01:25:55.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 -- 10.20.193.28:0/4138205443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe30810f060 msgr2=0x7fe30810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 --2- 10.20.193.28:0/4138205443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe30810f060 0x7fe30810f430 secure :-1 s=READY pgs=223 gs=2 cs=0 l=1 c_cookie=10971835627450516950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f80099a0 tx=0x7fe2f802ed00 comp rx=0 tx=0).stop 2026-02-13T01:25:55.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 -- 10.20.193.28:0/4138205443 shutdown_connections 2026-02-13T01:25:55.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 --2- 10.20.193.28:0/4138205443 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810fa50 0x7fe308114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 --2- 10.20.193.28:0/4138205443 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe308115270 0x7fe308175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 --2- 10.20.193.28:0/4138205443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe30810f060 0x7fe30810f430 unknown :-1 s=CLOSED pgs=223 gs=2 cs=0 l=1 c_cookie=10971835627450516950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 -- 10.20.193.28:0/4138205443 >> 10.20.193.28:0/4138205443 conn(0x7fe3080ec980 msgr2=0x7fe30810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:55.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 -- 10.20.193.28:0/4138205443 shutdown_connections 2026-02-13T01:25:55.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.470+0000 7fe30e1406c0 1 -- 10.20.193.28:0/4138205443 wait complete. 2026-02-13T01:25:55.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 Processor -- start 2026-02-13T01:25:55.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 -- start start 2026-02-13T01:25:55.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 0x7fe30811cf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308115270 0x7fe30811d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe308122880 0x7fe308122d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe308123290 con 0x7fe308115270 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe308123400 con 0x7fe308122880 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30e1406c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081235c0 con 0x7fe30810f060 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30d13e6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 0x7fe30811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30d13e6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 0x7fe30811cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:50408/0 (socket says 10.20.193.28:50408) 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30d13e6c0 1 -- 10.20.193.28:0/1087218612 learned_addr learned my addr 10.20.193.28:0/1087218612 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30d93f6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe308122880 0x7fe308122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.471+0000 7fe30c93d6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308115270 0x7fe30811d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30d13e6c0 1 -- 10.20.193.28:0/1087218612 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe308122880 msgr2=0x7fe308122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30d13e6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe308122880 0x7fe308122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30d13e6c0 1 -- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308115270 msgr2=0x7fe30811d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30d13e6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308115270 0x7fe30811d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30d13e6c0 1 -- 10.20.193.28:0/1087218612 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f8009590 con 0x7fe30810f060 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30c93d6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308115270 0x7fe30811d4c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe30d13e6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 0x7fe30811cf80 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f8031fd0 tx=0x7fe2f802fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2f8002ae0 con 0x7fe30810f060 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2f80046b0 con 0x7fe30810f060 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.472+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2f80372f0 con 0x7fe30810f060 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.473+0000 7fe30e1406c0 1 -- 10.20.193.28:0/1087218612 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe308163a10 con 0x7fe30810f060 2026-02-13T01:25:55.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.473+0000 7fe30e1406c0 1 -- 10.20.193.28:0/1087218612 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe308163e40 con 0x7fe30810f060 2026-02-13T01:25:55.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.473+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe308110330 con 0x7fe30810f060 2026-02-13T01:25:55.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.475+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fe2f8002c40 con 0x7fe30810f060 2026-02-13T01:25:55.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.477+0000 7fe2f67fc6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2e40b5690 0x7fe2e40d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.477+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fe2f8107be0 con 0x7fe30810f060 2026-02-13T01:25:55.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.477+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe2f8140640 con 0x7fe30810f060 2026-02-13T01:25:55.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.477+0000 7fe30c93d6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2e40b5690 0x7fe2e40d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.478+0000 7fe30c93d6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2e40b5690 0x7fe2e40d5b40 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe308123910 tx=0x7fe2fc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:55 trial134 ceph-mon[27948]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:55 trial134 ceph-mon[27948]: pgmap v207: 97 pgs: 7 peering, 90 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2026-02-13T01:25:55.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:55 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3152920974' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-13T01:25:55.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.577+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe30811e0d0 con 0x7fe2e40b5690 2026-02-13T01:25:55.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.579+0000 7fe2f67fc6c0 1 -- 10.20.193.28:0/1087218612 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258643 (secure 0 0 0) 0x7fe30811e0d0 con 0x7fe2e40b5690 2026-02-13T01:25:55.582 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:55.583 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:55.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2e40b5690 msgr2=0x7fe2e40d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2e40b5690 0x7fe2e40d5b40 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe308123910 tx=0x7fe2fc009260 comp rx=0 tx=0).stop 2026-02-13T01:25:55.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 msgr2=0x7fe30811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 0x7fe30811cf80 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f8031fd0 tx=0x7fe2f802fc60 comp rx=0 tx=0).stop 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 shutdown_connections 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe308122880 0x7fe308122d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308115270 0x7fe30811d4c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2e40b5690 0x7fe2e40d5b40 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 --2- 10.20.193.28:0/1087218612 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30810f060 0x7fe30811cf80 unknown :-1 s=CLOSED pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 >> 10.20.193.28:0/1087218612 conn(0x7fe3080ec980 msgr2=0x7fe30810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.581+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 shutdown_connections 2026-02-13T01:25:55.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:55.582+0000 7fe2d7fff6c0 1 -- 10.20.193.28:0/1087218612 wait complete. 2026-02-13T01:25:55.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:55 trial187 ceph-mon[27464]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:55.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:55 trial187 ceph-mon[27464]: pgmap v207: 97 pgs: 7 peering, 90 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2026-02-13T01:25:55.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:55 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3152920974' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2026-02-13T01:25:55.684 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2026-02-13T01:25:54.702304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661750,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":203,"num_read_kb":202,"num_write":348,"num_write_kb":3838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":289,"ondisk_log_size":289,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333684,"kb_used_data":10116,"kb_used_omap":410,"kb_used_meta":322917,"kb_avail":8807704716,"statfs":{"total":9019431321600,"available":9019089629184,"internally_reserved":0,"allocated":10358784,"data_stored":6653200,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":420438,"internal_metadata":330667434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41468,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":76,"num_write":19,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001714"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190205+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:50.190205+0000","last_peered":"2026-02-13T01:25:50.190205+0000","last_clean":"2026-02-13T01:25:50.190205+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:50.190205+0000","last_undegraded":"2026-02-13T01:25:50.190205+0000","last_fullsized":"2026-02-13T01:25:50.190205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197501+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:51.197501+0000","last_peered":"2026-02-13T01:25:51.197501+0000","last_clean":"2026-02-13T01:25:51.197501+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:51.197501+0000","last_undegraded":"2026-02-13T01:25:51.197501+0000","last_fullsized":"2026-02-13T01:25:51.197501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198074+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:51.198074+0000","last_peered":"2026-02-13T01:25:51.198074+0000","last_clean":"2026-02-13T01:25:51.198074+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:51.198074+0000","last_undegraded":"2026-02-13T01:25:51.198074+0000","last_fullsized":"2026-02-13T01:25:51.198074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191196+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:50.191196+0000","last_peered":"2026-02-13T01:25:50.191196+0000","last_clean":"2026-02-13T01:25:50.191196+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:50.191196+0000","last_undegraded":"2026-02-13T01:25:50.191196+0000","last_fullsized":"2026-02-13T01:25:50.191196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198461+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:51.198461+0000","last_peered":"2026-02-13T01:25:51.198461+0000","last_clean":"2026-02-13T01:25:51.198461+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:51.198461+0000","last_undegraded":"2026-02-13T01:25:51.198461+0000","last_fullsized":"2026-02-13T01:25:51.198461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196071+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:51.196071+0000","last_peered":"2026-02-13T01:25:51.196071+0000","last_clean":"2026-02-13T01:25:51.196071+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:51.196071+0000","last_undegraded":"2026-02-13T01:25:51.196071+0000","last_fullsized":"2026-02-13T01:25:51.196071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:37.626144+0000","last_change":"2026-02-13T01:25:50.191627+0000","last_active":"2026-02-13T01:25:50.191627+0000","last_peered":"2026-02-13T01:25:37.626144+0000","last_clean":"2026-02-13T01:25:37.626144+0000","last_became_active":"2026-02-13T01:25:36.136618+0000","last_became_peered":"2026-02-13T01:25:36.136618+0000","last_unstale":"2026-02-13T01:25:37.626144+0000","last_undegraded":"2026-02-13T01:25:37.626144+0000","last_fullsized":"2026-02-13T01:25:37.626144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,8,9],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195272+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:51.195272+0000","last_peered":"2026-02-13T01:25:51.195272+0000","last_clean":"2026-02-13T01:25:51.195272+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:51.195272+0000","last_undegraded":"2026-02-13T01:25:51.195272+0000","last_fullsized":"2026-02-13T01:25:51.195272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191666+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:50.191666+0000","last_peered":"2026-02-13T01:25:50.191666+0000","last_clean":"2026-02-13T01:25:50.191666+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:50.191666+0000","last_undegraded":"2026-02-13T01:25:50.191666+0000","last_fullsized":"2026-02-13T01:25:50.191666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196329+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:51.196329+0000","last_peered":"2026-02-13T01:25:51.196329+0000","last_clean":"2026-02-13T01:25:51.196329+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:51.196329+0000","last_undegraded":"2026-02-13T01:25:51.196329+0000","last_fullsized":"2026-02-13T01:25:51.196329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190973+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:50.190973+0000","last_peered":"2026-02-13T01:25:50.190973+0000","last_clean":"2026-02-13T01:25:50.190973+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:50.190973+0000","last_undegraded":"2026-02-13T01:25:50.190973+0000","last_fullsized":"2026-02-13T01:25:50.190973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191453+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:50.191453+0000","last_peered":"2026-02-13T01:25:50.191453+0000","last_clean":"2026-02-13T01:25:50.191453+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:50.191453+0000","last_undegraded":"2026-02-13T01:25:50.191453+0000","last_fullsized":"2026-02-13T01:25:50.191453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313904+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:51.313904+0000","last_peered":"2026-02-13T01:25:51.313904+0000","last_clean":"2026-02-13T01:25:51.313904+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:51.313904+0000","last_undegraded":"2026-02-13T01:25:51.313904+0000","last_fullsized":"2026-02-13T01:25:51.313904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196886+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:51.196886+0000","last_peered":"2026-02-13T01:25:51.196886+0000","last_clean":"2026-02-13T01:25:51.196886+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:51.196886+0000","last_undegraded":"2026-02-13T01:25:51.196886+0000","last_fullsized":"2026-02-13T01:25:51.196886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197818+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:51.197818+0000","last_peered":"2026-02-13T01:25:51.197818+0000","last_clean":"2026-02-13T01:25:51.197818+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:51.197818+0000","last_undegraded":"2026-02-13T01:25:51.197818+0000","last_fullsized":"2026-02-13T01:25:51.197818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190406+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:50.190406+0000","last_peered":"2026-02-13T01:25:50.190406+0000","last_clean":"2026-02-13T01:25:50.190406+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:50.190406+0000","last_undegraded":"2026-02-13T01:25:50.190406+0000","last_fullsized":"2026-02-13T01:25:50.190406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190283+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:50.190283+0000","last_peered":"2026-02-13T01:25:50.190283+0000","last_clean":"2026-02-13T01:25:50.190283+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:50.190283+0000","last_undegraded":"2026-02-13T01:25:50.190283+0000","last_fullsized":"2026-02-13T01:25:50.190283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195784+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:50.195784+0000","last_peered":"2026-02-13T01:25:50.195784+0000","last_clean":"2026-02-13T01:25:50.195784+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:50.195784+0000","last_undegraded":"2026-02-13T01:25:50.195784+0000","last_fullsized":"2026-02-13T01:25:50.195784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198259+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:51.198259+0000","last_peered":"2026-02-13T01:25:51.198259+0000","last_clean":"2026-02-13T01:25:51.198259+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:51.198259+0000","last_undegraded":"2026-02-13T01:25:51.198259+0000","last_fullsized":"2026-02-13T01:25:51.198259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190175+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:50.190175+0000","last_peered":"2026-02-13T01:25:50.190175+0000","last_clean":"2026-02-13T01:25:50.190175+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:50.190175+0000","last_undegraded":"2026-02-13T01:25:50.190175+0000","last_fullsized":"2026-02-13T01:25:50.190175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313927+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:51.313927+0000","last_peered":"2026-02-13T01:25:51.313927+0000","last_clean":"2026-02-13T01:25:51.313927+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:51.313927+0000","last_undegraded":"2026-02-13T01:25:51.313927+0000","last_fullsized":"2026-02-13T01:25:51.313927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190569+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:50.190569+0000","last_peered":"2026-02-13T01:25:50.190569+0000","last_clean":"2026-02-13T01:25:50.190569+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:50.190569+0000","last_undegraded":"2026-02-13T01:25:50.190569+0000","last_fullsized":"2026-02-13T01:25:50.190569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195760+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:51.195760+0000","last_peered":"2026-02-13T01:25:51.195760+0000","last_clean":"2026-02-13T01:25:51.195760+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:51.195760+0000","last_undegraded":"2026-02-13T01:25:51.195760+0000","last_fullsized":"2026-02-13T01:25:51.195760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196129+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:51.196129+0000","last_peered":"2026-02-13T01:25:51.196129+0000","last_clean":"2026-02-13T01:25:51.196129+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:51.196129+0000","last_undegraded":"2026-02-13T01:25:51.196129+0000","last_fullsized":"2026-02-13T01:25:51.196129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196225+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:51.196225+0000","last_peered":"2026-02-13T01:25:51.196225+0000","last_clean":"2026-02-13T01:25:51.196225+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:51.196225+0000","last_undegraded":"2026-02-13T01:25:51.196225+0000","last_fullsized":"2026-02-13T01:25:51.196225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198417+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:51.198417+0000","last_peered":"2026-02-13T01:25:51.198417+0000","last_clean":"2026-02-13T01:25:51.198417+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:51.198417+0000","last_undegraded":"2026-02-13T01:25:51.198417+0000","last_fullsized":"2026-02-13T01:25:51.198417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190053+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:50.190053+0000","last_peered":"2026-02-13T01:25:50.190053+0000","last_clean":"2026-02-13T01:25:50.190053+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:50.190053+0000","last_undegraded":"2026-02-13T01:25:50.190053+0000","last_fullsized":"2026-02-13T01:25:50.190053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313752+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:51.313752+0000","last_peered":"2026-02-13T01:25:51.313752+0000","last_clean":"2026-02-13T01:25:51.313752+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:51.313752+0000","last_undegraded":"2026-02-13T01:25:51.313752+0000","last_fullsized":"2026-02-13T01:25:51.313752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198382+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:51.198382+0000","last_peered":"2026-02-13T01:25:51.198382+0000","last_clean":"2026-02-13T01:25:51.198382+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:51.198382+0000","last_undegraded":"2026-02-13T01:25:51.198382+0000","last_fullsized":"2026-02-13T01:25:51.198382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198114+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:51.198114+0000","last_peered":"2026-02-13T01:25:51.198114+0000","last_clean":"2026-02-13T01:25:51.198114+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:51.198114+0000","last_undegraded":"2026-02-13T01:25:51.198114+0000","last_fullsized":"2026-02-13T01:25:51.198114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198181+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:51.198181+0000","last_peered":"2026-02-13T01:25:51.198181+0000","last_clean":"2026-02-13T01:25:51.198181+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:51.198181+0000","last_undegraded":"2026-02-13T01:25:51.198181+0000","last_fullsized":"2026-02-13T01:25:51.198181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190078+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:50.190078+0000","last_peered":"2026-02-13T01:25:50.190078+0000","last_clean":"2026-02-13T01:25:50.190078+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:50.190078+0000","last_undegraded":"2026-02-13T01:25:50.190078+0000","last_fullsized":"2026-02-13T01:25:50.190078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198516+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:51.198516+0000","last_peered":"2026-02-13T01:25:51.198516+0000","last_clean":"2026-02-13T01:25:51.198516+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:51.198516+0000","last_undegraded":"2026-02-13T01:25:51.198516+0000","last_fullsized":"2026-02-13T01:25:51.198516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.884918+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:51.884918+0000","last_peered":"2026-02-13T01:25:51.884918+0000","last_clean":"2026-02-13T01:25:51.884918+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:51.884918+0000","last_undegraded":"2026-02-13T01:25:51.884918+0000","last_fullsized":"2026-02-13T01:25:51.884918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.199322+0000","last_change":"2026-02-13T01:25:51.199266+0000","last_active":"2026-02-13T01:25:51.199322+0000","last_peered":"2026-02-13T01:25:51.199322+0000","last_clean":"2026-02-13T01:25:51.199322+0000","last_became_active":"2026-02-13T01:25:51.199062+0000","last_became_peered":"2026-02-13T01:25:51.199062+0000","last_unstale":"2026-02-13T01:25:51.199322+0000","last_undegraded":"2026-02-13T01:25:51.199322+0000","last_fullsized":"2026-02-13T01:25:51.199322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:44:34.983118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196184+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:51.196184+0000","last_peered":"2026-02-13T01:25:51.196184+0000","last_clean":"2026-02-13T01:25:51.196184+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:51.196184+0000","last_undegraded":"2026-02-13T01:25:51.196184+0000","last_fullsized":"2026-02-13T01:25:51.196184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313087+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:51.313087+0000","last_peered":"2026-02-13T01:25:51.313087+0000","last_clean":"2026-02-13T01:25:51.313087+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:51.313087+0000","last_undegraded":"2026-02-13T01:25:51.313087+0000","last_fullsized":"2026-02-13T01:25:51.313087+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195297+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:51.195297+0000","last_peered":"2026-02-13T01:25:51.195297+0000","last_clean":"2026-02-13T01:25:51.195297+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:51.195297+0000","last_undegraded":"2026-02-13T01:25:51.195297+0000","last_fullsized":"2026-02-13T01:25:51.195297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196387+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:51.196387+0000","last_peered":"2026-02-13T01:25:51.196387+0000","last_clean":"2026-02-13T01:25:51.196387+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:51.196387+0000","last_undegraded":"2026-02-13T01:25:51.196387+0000","last_fullsized":"2026-02-13T01:25:51.196387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.817516+0000","last_change":"2026-02-13T01:25:50.193701+0000","last_active":"2026-02-13T01:25:50.193701+0000","last_peered":"2026-02-13T01:25:39.817516+0000","last_clean":"2026-02-13T01:25:39.817516+0000","last_became_active":"2026-02-13T01:25:36.146372+0000","last_became_peered":"2026-02-13T01:25:36.146372+0000","last_unstale":"2026-02-13T01:25:39.817516+0000","last_undegraded":"2026-02-13T01:25:39.817516+0000","last_fullsized":"2026-02-13T01:25:39.817516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,6,10],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196292+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:51.196292+0000","last_peered":"2026-02-13T01:25:51.196292+0000","last_clean":"2026-02-13T01:25:51.196292+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:51.196292+0000","last_undegraded":"2026-02-13T01:25:51.196292+0000","last_fullsized":"2026-02-13T01:25:51.196292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191488+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:50.191488+0000","last_peered":"2026-02-13T01:25:50.191488+0000","last_clean":"2026-02-13T01:25:50.191488+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:50.191488+0000","last_undegraded":"2026-02-13T01:25:50.191488+0000","last_fullsized":"2026-02-13T01:25:50.191488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190950+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:50.190950+0000","last_peered":"2026-02-13T01:25:50.190950+0000","last_clean":"2026-02-13T01:25:50.190950+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:50.190950+0000","last_undegraded":"2026-02-13T01:25:50.190950+0000","last_fullsized":"2026-02-13T01:25:50.190950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198640+0000","last_change":"2026-02-13T01:25:51.198614+0000","last_active":"2026-02-13T01:25:51.198640+0000","last_peered":"2026-02-13T01:25:51.198640+0000","last_clean":"2026-02-13T01:25:51.198640+0000","last_became_active":"2026-02-13T01:25:51.198509+0000","last_became_peered":"2026-02-13T01:25:51.198509+0000","last_unstale":"2026-02-13T01:25:51.198640+0000","last_undegraded":"2026-02-13T01:25:51.198640+0000","last_fullsized":"2026-02-13T01:25:51.198640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:38:06.081050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196506+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:51.196506+0000","last_peered":"2026-02-13T01:25:51.196506+0000","last_clean":"2026-02-13T01:25:51.196506+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:51.196506+0000","last_undegraded":"2026-02-13T01:25:51.196506+0000","last_fullsized":"2026-02-13T01:25:51.196506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191348+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:50.191348+0000","last_peered":"2026-02-13T01:25:50.191348+0000","last_clean":"2026-02-13T01:25:50.191348+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:50.191348+0000","last_undegraded":"2026-02-13T01:25:50.191348+0000","last_fullsized":"2026-02-13T01:25:50.191348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'27","reported_seq":77,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:52.025263+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:52.025263+0000","last_peered":"2026-02-13T01:25:52.025263+0000","last_clean":"2026-02-13T01:25:52.025263+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:52.025263+0000","last_undegraded":"2026-02-13T01:25:52.025263+0000","last_fullsized":"2026-02-13T01:25:52.025263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67062,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":67,"num_write":28,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198579+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:51.198579+0000","last_peered":"2026-02-13T01:25:51.198579+0000","last_clean":"2026-02-13T01:25:51.198579+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:51.198579+0000","last_undegraded":"2026-02-13T01:25:51.198579+0000","last_fullsized":"2026-02-13T01:25:51.198579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198199+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:51.198199+0000","last_peered":"2026-02-13T01:25:51.198199+0000","last_clean":"2026-02-13T01:25:51.198199+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:51.198199+0000","last_undegraded":"2026-02-13T01:25:51.198199+0000","last_fullsized":"2026-02-13T01:25:51.198199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313427+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:51.313427+0000","last_peered":"2026-02-13T01:25:51.313427+0000","last_clean":"2026-02-13T01:25:51.313427+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:51.313427+0000","last_undegraded":"2026-02-13T01:25:51.313427+0000","last_fullsized":"2026-02-13T01:25:51.313427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196207+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:51.196207+0000","last_peered":"2026-02-13T01:25:51.196207+0000","last_clean":"2026-02-13T01:25:51.196207+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:51.196207+0000","last_undegraded":"2026-02-13T01:25:51.196207+0000","last_fullsized":"2026-02-13T01:25:51.196207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191360+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:50.191360+0000","last_peered":"2026-02-13T01:25:50.191360+0000","last_clean":"2026-02-13T01:25:50.191360+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:50.191360+0000","last_undegraded":"2026-02-13T01:25:50.191360+0000","last_fullsized":"2026-02-13T01:25:50.191360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190813+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:50.190813+0000","last_peered":"2026-02-13T01:25:50.190813+0000","last_clean":"2026-02-13T01:25:50.190813+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:50.190813+0000","last_undegraded":"2026-02-13T01:25:50.190813+0000","last_fullsized":"2026-02-13T01:25:50.190813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190863+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:50.190863+0000","last_peered":"2026-02-13T01:25:50.190863+0000","last_clean":"2026-02-13T01:25:50.190863+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:50.190863+0000","last_undegraded":"2026-02-13T01:25:50.190863+0000","last_fullsized":"2026-02-13T01:25:50.190863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198386+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:51.198386+0000","last_peered":"2026-02-13T01:25:51.198386+0000","last_clean":"2026-02-13T01:25:51.198386+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:51.198386+0000","last_undegraded":"2026-02-13T01:25:51.198386+0000","last_fullsized":"2026-02-13T01:25:51.198386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196184+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:51.196184+0000","last_peered":"2026-02-13T01:25:51.196184+0000","last_clean":"2026-02-13T01:25:51.196184+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:51.196184+0000","last_undegraded":"2026-02-13T01:25:51.196184+0000","last_fullsized":"2026-02-13T01:25:51.196184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198688+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:51.198688+0000","last_peered":"2026-02-13T01:25:51.198688+0000","last_clean":"2026-02-13T01:25:51.198688+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:51.198688+0000","last_undegraded":"2026-02-13T01:25:51.198688+0000","last_fullsized":"2026-02-13T01:25:51.198688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:39.889644+0000","last_change":"2026-02-13T01:25:50.190333+0000","last_active":"2026-02-13T01:25:50.190333+0000","last_peered":"2026-02-13T01:25:39.889644+0000","last_clean":"2026-02-13T01:25:39.889644+0000","last_became_active":"2026-02-13T01:25:36.138102+0000","last_became_peered":"2026-02-13T01:25:36.138102+0000","last_unstale":"2026-02-13T01:25:39.889644+0000","last_undegraded":"2026-02-13T01:25:39.889644+0000","last_fullsized":"2026-02-13T01:25:39.889644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,7],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313698+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:51.313698+0000","last_peered":"2026-02-13T01:25:51.313698+0000","last_clean":"2026-02-13T01:25:51.313698+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:51.313698+0000","last_undegraded":"2026-02-13T01:25:51.313698+0000","last_fullsized":"2026-02-13T01:25:51.313698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191659+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:50.191659+0000","last_peered":"2026-02-13T01:25:50.191659+0000","last_clean":"2026-02-13T01:25:50.191659+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:50.191659+0000","last_undegraded":"2026-02-13T01:25:50.191659+0000","last_fullsized":"2026-02-13T01:25:50.191659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196547+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:51.196547+0000","last_peered":"2026-02-13T01:25:51.196547+0000","last_clean":"2026-02-13T01:25:51.196547+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:51.196547+0000","last_undegraded":"2026-02-13T01:25:51.196547+0000","last_fullsized":"2026-02-13T01:25:51.196547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":16,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:43.404136+0000","last_change":"2026-02-13T01:25:50.191853+0000","last_active":"2026-02-13T01:25:50.191853+0000","last_peered":"2026-02-13T01:25:43.404136+0000","last_clean":"2026-02-13T01:25:43.404136+0000","last_became_active":"2026-02-13T01:25:36.140854+0000","last_became_peered":"2026-02-13T01:25:36.140854+0000","last_unstale":"2026-02-13T01:25:43.404136+0000","last_undegraded":"2026-02-13T01:25:43.404136+0000","last_fullsized":"2026-02-13T01:25:43.404136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5,8],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198298+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:51.198298+0000","last_peered":"2026-02-13T01:25:51.198298+0000","last_clean":"2026-02-13T01:25:51.198298+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:51.198298+0000","last_undegraded":"2026-02-13T01:25:51.198298+0000","last_fullsized":"2026-02-13T01:25:51.198298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":341,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191117+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:50.191117+0000","last_peered":"2026-02-13T01:25:50.191117+0000","last_clean":"2026-02-13T01:25:50.191117+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:50.191117+0000","last_undegraded":"2026-02-13T01:25:50.191117+0000","last_fullsized":"2026-02-13T01:25:50.191117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191819+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:50.191819+0000","last_peered":"2026-02-13T01:25:50.191819+0000","last_clean":"2026-02-13T01:25:50.191819+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:50.191819+0000","last_undegraded":"2026-02-13T01:25:50.191819+0000","last_fullsized":"2026-02-13T01:25:50.191819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196012+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:51.196012+0000","last_peered":"2026-02-13T01:25:51.196012+0000","last_clean":"2026-02-13T01:25:51.196012+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:51.196012+0000","last_undegraded":"2026-02-13T01:25:51.196012+0000","last_fullsized":"2026-02-13T01:25:51.196012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191028+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:50.191028+0000","last_peered":"2026-02-13T01:25:50.191028+0000","last_clean":"2026-02-13T01:25:50.191028+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:50.191028+0000","last_undegraded":"2026-02-13T01:25:50.191028+0000","last_fullsized":"2026-02-13T01:25:50.191028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313058+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:51.313058+0000","last_peered":"2026-02-13T01:25:51.313058+0000","last_clean":"2026-02-13T01:25:51.313058+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:51.313058+0000","last_undegraded":"2026-02-13T01:25:51.313058+0000","last_fullsized":"2026-02-13T01:25:51.313058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.888030+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:51.888030+0000","last_peered":"2026-02-13T01:25:51.888030+0000","last_clean":"2026-02-13T01:25:51.888030+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:51.888030+0000","last_undegraded":"2026-02-13T01:25:51.888030+0000","last_fullsized":"2026-02-13T01:25:51.888030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.317625+0000","last_change":"2026-02-13T01:25:51.317569+0000","last_active":"2026-02-13T01:25:51.317625+0000","last_peered":"2026-02-13T01:25:51.317625+0000","last_clean":"2026-02-13T01:25:51.317625+0000","last_became_active":"2026-02-13T01:25:51.317414+0000","last_became_peered":"2026-02-13T01:25:51.317414+0000","last_unstale":"2026-02-13T01:25:51.317625+0000","last_undegraded":"2026-02-13T01:25:51.317625+0000","last_fullsized":"2026-02-13T01:25:51.317625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:03:14.594804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191197+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:50.191197+0000","last_peered":"2026-02-13T01:25:50.191197+0000","last_clean":"2026-02-13T01:25:50.191197+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:50.191197+0000","last_undegraded":"2026-02-13T01:25:50.191197+0000","last_fullsized":"2026-02-13T01:25:50.191197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196345+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:51.196345+0000","last_peered":"2026-02-13T01:25:51.196345+0000","last_clean":"2026-02-13T01:25:51.196345+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:51.196345+0000","last_undegraded":"2026-02-13T01:25:51.196345+0000","last_fullsized":"2026-02-13T01:25:51.196345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195371+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:50.195371+0000","last_peered":"2026-02-13T01:25:50.195371+0000","last_clean":"2026-02-13T01:25:50.195371+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:50.195371+0000","last_undegraded":"2026-02-13T01:25:50.195371+0000","last_fullsized":"2026-02-13T01:25:50.195371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196244+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:51.196244+0000","last_peered":"2026-02-13T01:25:51.196244+0000","last_clean":"2026-02-13T01:25:51.196244+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:51.196244+0000","last_undegraded":"2026-02-13T01:25:51.196244+0000","last_fullsized":"2026-02-13T01:25:51.196244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198660+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:51.198660+0000","last_peered":"2026-02-13T01:25:51.198660+0000","last_clean":"2026-02-13T01:25:51.198660+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:51.198660+0000","last_undegraded":"2026-02-13T01:25:51.198660+0000","last_fullsized":"2026-02-13T01:25:51.198660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313776+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:51.313776+0000","last_peered":"2026-02-13T01:25:51.313776+0000","last_clean":"2026-02-13T01:25:51.313776+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:51.313776+0000","last_undegraded":"2026-02-13T01:25:51.313776+0000","last_fullsized":"2026-02-13T01:25:51.313776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195820+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:50.195820+0000","last_peered":"2026-02-13T01:25:50.195820+0000","last_clean":"2026-02-13T01:25:50.195820+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:50.195820+0000","last_undegraded":"2026-02-13T01:25:50.195820+0000","last_fullsized":"2026-02-13T01:25:50.195820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196352+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:51.196352+0000","last_peered":"2026-02-13T01:25:51.196352+0000","last_clean":"2026-02-13T01:25:51.196352+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:51.196352+0000","last_undegraded":"2026-02-13T01:25:51.196352+0000","last_fullsized":"2026-02-13T01:25:51.196352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191449+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:50.191449+0000","last_peered":"2026-02-13T01:25:50.191449+0000","last_clean":"2026-02-13T01:25:50.191449+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:50.191449+0000","last_undegraded":"2026-02-13T01:25:50.191449+0000","last_fullsized":"2026-02-13T01:25:50.191449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197934+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:51.197934+0000","last_peered":"2026-02-13T01:25:51.197934+0000","last_clean":"2026-02-13T01:25:51.197934+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:51.197934+0000","last_undegraded":"2026-02-13T01:25:51.197934+0000","last_fullsized":"2026-02-13T01:25:51.197934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"peering","last_fresh":"2026-02-13T01:25:38.865000+0000","last_change":"2026-02-13T01:25:50.190866+0000","last_active":"2026-02-13T01:25:50.190866+0000","last_peered":"2026-02-13T01:25:38.865000+0000","last_clean":"2026-02-13T01:25:38.865000+0000","last_became_active":"2026-02-13T01:25:35.141256+0000","last_became_peered":"2026-02-13T01:25:35.141256+0000","last_unstale":"2026-02-13T01:25:38.865000+0000","last_undegraded":"2026-02-13T01:25:38.865000+0000","last_fullsized":"2026-02-13T01:25:38.865000+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198635+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:51.198635+0000","last_peered":"2026-02-13T01:25:51.198635+0000","last_clean":"2026-02-13T01:25:51.198635+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:51.198635+0000","last_undegraded":"2026-02-13T01:25:51.198635+0000","last_fullsized":"2026-02-13T01:25:51.198635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195784+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:51.195784+0000","last_peered":"2026-02-13T01:25:51.195784+0000","last_clean":"2026-02-13T01:25:51.195784+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:51.195784+0000","last_undegraded":"2026-02-13T01:25:51.195784+0000","last_fullsized":"2026-02-13T01:25:51.195784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.190396+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:50.190396+0000","last_peered":"2026-02-13T01:25:50.190396+0000","last_clean":"2026-02-13T01:25:50.190396+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:50.190396+0000","last_undegraded":"2026-02-13T01:25:50.190396+0000","last_fullsized":"2026-02-13T01:25:50.190396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198130+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:51.198130+0000","last_peered":"2026-02-13T01:25:51.198130+0000","last_clean":"2026-02-13T01:25:51.198130+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:51.198130+0000","last_undegraded":"2026-02-13T01:25:51.198130+0000","last_fullsized":"2026-02-13T01:25:51.198130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195661+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:51.195661+0000","last_peered":"2026-02-13T01:25:51.195661+0000","last_clean":"2026-02-13T01:25:51.195661+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:51.195661+0000","last_undegraded":"2026-02-13T01:25:51.195661+0000","last_fullsized":"2026-02-13T01:25:51.195661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198486+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:51.198486+0000","last_peered":"2026-02-13T01:25:51.198486+0000","last_clean":"2026-02-13T01:25:51.198486+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:51.198486+0000","last_undegraded":"2026-02-13T01:25:51.198486+0000","last_fullsized":"2026-02-13T01:25:51.198486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191207+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:50.191207+0000","last_peered":"2026-02-13T01:25:50.191207+0000","last_clean":"2026-02-13T01:25:50.191207+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:50.191207+0000","last_undegraded":"2026-02-13T01:25:50.191207+0000","last_fullsized":"2026-02-13T01:25:50.191207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196421+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:51.196421+0000","last_peered":"2026-02-13T01:25:51.196421+0000","last_clean":"2026-02-13T01:25:51.196421+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:51.196421+0000","last_undegraded":"2026-02-13T01:25:51.196421+0000","last_fullsized":"2026-02-13T01:25:51.196421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198751+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:51.198751+0000","last_peered":"2026-02-13T01:25:51.198751+0000","last_clean":"2026-02-13T01:25:51.198751+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:51.198751+0000","last_undegraded":"2026-02-13T01:25:51.198751+0000","last_fullsized":"2026-02-13T01:25:51.198751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.191230+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:50.191230+0000","last_peered":"2026-02-13T01:25:50.191230+0000","last_clean":"2026-02-13T01:25:50.191230+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:50.191230+0000","last_undegraded":"2026-02-13T01:25:50.191230+0000","last_fullsized":"2026-02-13T01:25:50.191230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:38.432332+0000","last_change":"2026-02-13T01:25:50.570263+0000","last_active":"2026-02-13T01:25:50.570263+0000","last_peered":"2026-02-13T01:25:38.432332+0000","last_clean":"2026-02-13T01:25:38.432332+0000","last_became_active":"2026-02-13T01:25:35.134066+0000","last_became_peered":"2026-02-13T01:25:35.134066+0000","last_unstale":"2026-02-13T01:25:38.432332+0000","last_undegraded":"2026-02-13T01:25:38.432332+0000","last_fullsized":"2026-02-13T01:25:38.432332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196842+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:51.196842+0000","last_peered":"2026-02-13T01:25:51.196842+0000","last_clean":"2026-02-13T01:25:51.196842+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:51.196842+0000","last_undegraded":"2026-02-13T01:25:51.196842+0000","last_fullsized":"2026-02-13T01:25:51.196842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196144+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:51.196144+0000","last_peered":"2026-02-13T01:25:51.196144+0000","last_clean":"2026-02-13T01:25:51.196144+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:51.196144+0000","last_undegraded":"2026-02-13T01:25:51.196144+0000","last_fullsized":"2026-02-13T01:25:51.196144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":76,"state":"peering","last_fresh":"2026-02-13T01:25:36.137991+0000","last_change":"2026-02-13T01:25:50.461647+0000","last_active":"2026-02-13T01:25:50.461647+0000","last_peered":"2026-02-13T01:25:35.123396+0000","last_clean":"2026-02-13T01:25:35.123396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-13T01:25:36.137991+0000","last_undegraded":"2026-02-13T01:25:36.137991+0000","last_fullsized":"2026-02-13T01:25:36.137991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:50.195664+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:50.195664+0000","last_peered":"2026-02-13T01:25:50.195664+0000","last_clean":"2026-02-13T01:25:50.195664+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:50.195664+0000","last_undegraded":"2026-02-13T01:25:50.195664+0000","last_fullsized":"2026-02-13T01:25:50.195664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71148,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":111,"num_write":157,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":189072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":151227,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":389920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6660,"internal_metadata":27583996},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1044577,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28798,"internal_metadata":27561858},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":381614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25621,"internal_metadata":27565035},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":398493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34359,"internal_metadata":27556297},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528336,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":982025,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19535,"internal_metadata":27571121},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":397823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28371,"internal_metadata":27562285},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920789,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":989892,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33997,"internal_metadata":27556659},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051605,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":381418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40761,"internal_metadata":27549895},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280535,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":398134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49820,"internal_metadata":27540836},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":445974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59562,"internal_metadata":27531094},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":444192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771100,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":399138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47332,"internal_metadata":27543324},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2300,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33504,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30310,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11057,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2793,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8230,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18030,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12916,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23867,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2424,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:56.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:56 trial134 ceph-mon[27948]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:56.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:56 trial187 ceph-mon[27464]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:56.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:56 trial028 ceph-mon[22984]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:57.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:57 trial134 ceph-mon[27948]: pgmap v208: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 7 op/s; 14 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:25:57.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:57 trial187 ceph-mon[27464]: pgmap v208: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 7 op/s; 14 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:25:57.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:57 trial028 ceph-mon[22984]: pgmap v208: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 1.9 KiB/s wr, 7 op/s; 14 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:25:58.692 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:58.876 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:59.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2658223684 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd26410d970 msgr2=0x7fd2641129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2658223684 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd26410d970 0x7fd2641129b0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=14591273077334381886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd258009970 tx=0x7fd25802ed10 comp rx=0 tx=0).stop 2026-02-13T01:25:59.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2658223684 shutdown_connections 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2658223684 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd264113190 0x7fd264173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2658223684 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd26410d970 0x7fd2641129b0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=14591273077334381886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2658223684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd26410cf80 0x7fd26410d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2658223684 >> 10.20.193.28:0/2658223684 conn(0x7fd2640ea880 msgr2=0x7fd26410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2658223684 shutdown_connections 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.062+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2658223684 wait complete. 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 Processor -- start 2026-02-13T01:25:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 -- start start 2026-02-13T01:25:59.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 0x7fd264062070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd264113190 0x7fd264173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd2640605e0 0x7fd264060a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd264060fc0 con 0x7fd264113190 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd264061130 con 0x7fd2640605e0 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.063+0000 7fd2698c76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd2640612f0 con 0x7fd26410cf80 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2627fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd264113190 0x7fd264173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 0x7fd264062070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 0x7fd264062070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:42866/0 (socket says 10.20.193.28:42866) 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 -- 10.20.193.28:0/2036828595 learned_addr learned my addr 10.20.193.28:0/2036828595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2637fe6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd2640605e0 0x7fd264060a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 -- 10.20.193.28:0/2036828595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd2640605e0 msgr2=0x7fd264060a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd2640605e0 0x7fd264060a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 -- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd264113190 msgr2=0x7fd264173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd264113190 0x7fd264173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 -- 10.20.193.28:0/2036828595 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd258009590 con 0x7fd26410cf80 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2627fc6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd264113190 0x7fd264173a30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd262ffd6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 0x7fd264062070 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd254006e50 tx=0x7fd25400ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd254003c40 con 0x7fd26410cf80 2026-02-13T01:25:59.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd25400a070 con 0x7fd26410cf80 2026-02-13T01:25:59.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2540081c0 con 0x7fd26410cf80 2026-02-13T01:25:59.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2640ff540 con 0x7fd26410cf80 2026-02-13T01:25:59.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.064+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2640ffa20 con 0x7fd26410cf80 2026-02-13T01:25:59.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.065+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26410e250 con 0x7fd26410cf80 2026-02-13T01:25:59.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.067+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fd254005030 con 0x7fd26410cf80 2026-02-13T01:25:59.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.069+0000 7fd2688c16c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2380b5690 0x7fd2380d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.069+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fd2540e4c80 con 0x7fd26410cf80 2026-02-13T01:25:59.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.069+0000 7fd2627fc6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2380b5690 0x7fd2380d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.069+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2540e5100 con 0x7fd26410cf80 2026-02-13T01:25:59.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.070+0000 7fd2627fc6c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2380b5690 0x7fd2380d5b40 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2640f6900 tx=0x7fd2580023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:59.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.168+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 --> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd264052a50 con 0x7fd2380b5690 2026-02-13T01:25:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.171+0000 7fd2688c16c0 1 -- 10.20.193.28:0/2036828595 <== mgr.14116 v2:10.20.193.28:6800/378944679 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258971 (secure 0 0 0) 0x7fd264052a50 con 0x7fd2380b5690 2026-02-13T01:25:59.174 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:59.176 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-13T01:25:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2380b5690 msgr2=0x7fd2380d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2380b5690 0x7fd2380d5b40 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2640f6900 tx=0x7fd2580023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 msgr2=0x7fd264062070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 0x7fd264062070 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd254006e50 tx=0x7fd25400ced0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 shutdown_connections 2026-02-13T01:25:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd2640605e0 0x7fd264060a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd264113190 0x7fd264173a30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd2380b5690 0x7fd2380d5b40 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 --2- 10.20.193.28:0/2036828595 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd26410cf80 0x7fd264062070 unknown :-1 s=CLOSED pgs=97 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 >> 10.20.193.28:0/2036828595 conn(0x7fd2640ea880 msgr2=0x7fd2641118d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 shutdown_connections 2026-02-13T01:25:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.174+0000 7fd2698c76c0 1 -- 10.20.193.28:0/2036828595 wait complete. 2026-02-13T01:25:59.277 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2026-02-13T01:25:58.703298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661750,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":348,"num_write_kb":3838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180853,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":289,"ondisk_log_size":289,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":289,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333816,"kb_used_data":10248,"kb_used_omap":419,"kb_used_meta":322908,"kb_avail":8807704584,"statfs":{"total":9019431321600,"available":9019089494016,"internally_reserved":0,"allocated":10493952,"data_stored":6756642,"data_compressed":114885,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":429318,"internal_metadata":330658554},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12186,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":43,"num_write":6,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":117,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.515908"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197264+0000","last_change":"2026-02-13T01:25:36.145105+0000","last_active":"2026-02-13T01:25:51.197264+0000","last_peered":"2026-02-13T01:25:51.197264+0000","last_clean":"2026-02-13T01:25:51.197264+0000","last_became_active":"2026-02-13T01:25:36.144933+0000","last_became_peered":"2026-02-13T01:25:36.144933+0000","last_unstale":"2026-02-13T01:25:51.197264+0000","last_undegraded":"2026-02-13T01:25:51.197264+0000","last_fullsized":"2026-02-13T01:25:51.197264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:38.839826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197501+0000","last_change":"2026-02-13T01:25:36.141925+0000","last_active":"2026-02-13T01:25:51.197501+0000","last_peered":"2026-02-13T01:25:51.197501+0000","last_clean":"2026-02-13T01:25:51.197501+0000","last_became_active":"2026-02-13T01:25:36.141748+0000","last_became_peered":"2026-02-13T01:25:36.141748+0000","last_unstale":"2026-02-13T01:25:51.197501+0000","last_undegraded":"2026-02-13T01:25:51.197501+0000","last_fullsized":"2026-02-13T01:25:51.197501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:52:35.828401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198074+0000","last_change":"2026-02-13T01:25:36.141000+0000","last_active":"2026-02-13T01:25:51.198074+0000","last_peered":"2026-02-13T01:25:51.198074+0000","last_clean":"2026-02-13T01:25:51.198074+0000","last_became_active":"2026-02-13T01:25:36.140885+0000","last_became_peered":"2026-02-13T01:25:36.140885+0000","last_unstale":"2026-02-13T01:25:51.198074+0000","last_undegraded":"2026-02-13T01:25:51.198074+0000","last_fullsized":"2026-02-13T01:25:51.198074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:30.707310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.627762+0000","last_change":"2026-02-13T01:25:36.133101+0000","last_active":"2026-02-13T01:25:51.627762+0000","last_peered":"2026-02-13T01:25:51.627762+0000","last_clean":"2026-02-13T01:25:51.627762+0000","last_became_active":"2026-02-13T01:25:36.132894+0000","last_became_peered":"2026-02-13T01:25:36.132894+0000","last_unstale":"2026-02-13T01:25:51.627762+0000","last_undegraded":"2026-02-13T01:25:51.627762+0000","last_fullsized":"2026-02-13T01:25:51.627762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:26.670846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198461+0000","last_change":"2026-02-13T01:25:36.142039+0000","last_active":"2026-02-13T01:25:51.198461+0000","last_peered":"2026-02-13T01:25:51.198461+0000","last_clean":"2026-02-13T01:25:51.198461+0000","last_became_active":"2026-02-13T01:25:36.141904+0000","last_became_peered":"2026-02-13T01:25:36.141904+0000","last_unstale":"2026-02-13T01:25:51.198461+0000","last_undegraded":"2026-02-13T01:25:51.198461+0000","last_fullsized":"2026-02-13T01:25:51.198461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:17:02.216539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196071+0000","last_change":"2026-02-13T01:25:36.138703+0000","last_active":"2026-02-13T01:25:51.196071+0000","last_peered":"2026-02-13T01:25:51.196071+0000","last_clean":"2026-02-13T01:25:51.196071+0000","last_became_active":"2026-02-13T01:25:36.138492+0000","last_became_peered":"2026-02-13T01:25:36.138492+0000","last_unstale":"2026-02-13T01:25:51.196071+0000","last_undegraded":"2026-02-13T01:25:51.196071+0000","last_fullsized":"2026-02-13T01:25:51.196071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:18.398503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.200021+0000","last_change":"2026-02-13T01:25:51.199975+0000","last_active":"2026-02-13T01:25:51.200021+0000","last_peered":"2026-02-13T01:25:51.200021+0000","last_clean":"2026-02-13T01:25:51.200021+0000","last_became_active":"2026-02-13T01:25:51.199830+0000","last_became_peered":"2026-02-13T01:25:51.199830+0000","last_unstale":"2026-02-13T01:25:51.200021+0000","last_undegraded":"2026-02-13T01:25:51.200021+0000","last_fullsized":"2026-02-13T01:25:51.200021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:48.463028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195272+0000","last_change":"2026-02-13T01:25:36.140107+0000","last_active":"2026-02-13T01:25:51.195272+0000","last_peered":"2026-02-13T01:25:51.195272+0000","last_clean":"2026-02-13T01:25:51.195272+0000","last_became_active":"2026-02-13T01:25:36.139683+0000","last_became_peered":"2026-02-13T01:25:36.139683+0000","last_unstale":"2026-02-13T01:25:51.195272+0000","last_undegraded":"2026-02-13T01:25:51.195272+0000","last_fullsized":"2026-02-13T01:25:51.195272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:38.677515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.199043+0000","last_change":"2026-02-13T01:25:36.137393+0000","last_active":"2026-02-13T01:25:51.199043+0000","last_peered":"2026-02-13T01:25:51.199043+0000","last_clean":"2026-02-13T01:25:51.199043+0000","last_became_active":"2026-02-13T01:25:36.137221+0000","last_became_peered":"2026-02-13T01:25:36.137221+0000","last_unstale":"2026-02-13T01:25:51.199043+0000","last_undegraded":"2026-02-13T01:25:51.199043+0000","last_fullsized":"2026-02-13T01:25:51.199043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:57.209926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196329+0000","last_change":"2026-02-13T01:25:36.135085+0000","last_active":"2026-02-13T01:25:51.196329+0000","last_peered":"2026-02-13T01:25:51.196329+0000","last_clean":"2026-02-13T01:25:51.196329+0000","last_became_active":"2026-02-13T01:25:36.134930+0000","last_became_peered":"2026-02-13T01:25:36.134930+0000","last_unstale":"2026-02-13T01:25:51.196329+0000","last_undegraded":"2026-02-13T01:25:51.196329+0000","last_fullsized":"2026-02-13T01:25:51.196329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:23:38.050081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197476+0000","last_change":"2026-02-13T01:25:36.135888+0000","last_active":"2026-02-13T01:25:51.197476+0000","last_peered":"2026-02-13T01:25:51.197476+0000","last_clean":"2026-02-13T01:25:51.197476+0000","last_became_active":"2026-02-13T01:25:36.135707+0000","last_became_peered":"2026-02-13T01:25:36.135707+0000","last_unstale":"2026-02-13T01:25:51.197476+0000","last_undegraded":"2026-02-13T01:25:51.197476+0000","last_fullsized":"2026-02-13T01:25:51.197476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:11:24.430815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.627810+0000","last_change":"2026-02-13T01:25:36.133952+0000","last_active":"2026-02-13T01:25:51.627810+0000","last_peered":"2026-02-13T01:25:51.627810+0000","last_clean":"2026-02-13T01:25:51.627810+0000","last_became_active":"2026-02-13T01:25:36.133686+0000","last_became_peered":"2026-02-13T01:25:36.133686+0000","last_unstale":"2026-02-13T01:25:51.627810+0000","last_undegraded":"2026-02-13T01:25:51.627810+0000","last_fullsized":"2026-02-13T01:25:51.627810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:40.987996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313904+0000","last_change":"2026-02-13T01:25:36.135918+0000","last_active":"2026-02-13T01:25:51.313904+0000","last_peered":"2026-02-13T01:25:51.313904+0000","last_clean":"2026-02-13T01:25:51.313904+0000","last_became_active":"2026-02-13T01:25:36.135753+0000","last_became_peered":"2026-02-13T01:25:36.135753+0000","last_unstale":"2026-02-13T01:25:51.313904+0000","last_undegraded":"2026-02-13T01:25:51.313904+0000","last_fullsized":"2026-02-13T01:25:51.313904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:40.581047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196886+0000","last_change":"2026-02-13T01:25:36.142920+0000","last_active":"2026-02-13T01:25:51.196886+0000","last_peered":"2026-02-13T01:25:51.196886+0000","last_clean":"2026-02-13T01:25:51.196886+0000","last_became_active":"2026-02-13T01:25:36.142706+0000","last_became_peered":"2026-02-13T01:25:36.142706+0000","last_unstale":"2026-02-13T01:25:51.196886+0000","last_undegraded":"2026-02-13T01:25:51.196886+0000","last_fullsized":"2026-02-13T01:25:51.196886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:25:46.740575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197818+0000","last_change":"2026-02-13T01:25:36.137254+0000","last_active":"2026-02-13T01:25:51.197818+0000","last_peered":"2026-02-13T01:25:51.197818+0000","last_clean":"2026-02-13T01:25:51.197818+0000","last_became_active":"2026-02-13T01:25:36.137097+0000","last_became_peered":"2026-02-13T01:25:36.137097+0000","last_unstale":"2026-02-13T01:25:51.197818+0000","last_undegraded":"2026-02-13T01:25:51.197818+0000","last_fullsized":"2026-02-13T01:25:51.197818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:00:18.655137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198663+0000","last_change":"2026-02-13T01:25:36.143398+0000","last_active":"2026-02-13T01:25:51.198663+0000","last_peered":"2026-02-13T01:25:51.198663+0000","last_clean":"2026-02-13T01:25:51.198663+0000","last_became_active":"2026-02-13T01:25:36.143185+0000","last_became_peered":"2026-02-13T01:25:36.143185+0000","last_unstale":"2026-02-13T01:25:51.198663+0000","last_undegraded":"2026-02-13T01:25:51.198663+0000","last_fullsized":"2026-02-13T01:25:51.198663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:28.369260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197265+0000","last_change":"2026-02-13T01:25:36.145153+0000","last_active":"2026-02-13T01:25:51.197265+0000","last_peered":"2026-02-13T01:25:51.197265+0000","last_clean":"2026-02-13T01:25:51.197265+0000","last_became_active":"2026-02-13T01:25:36.144930+0000","last_became_peered":"2026-02-13T01:25:36.144930+0000","last_unstale":"2026-02-13T01:25:51.197265+0000","last_undegraded":"2026-02-13T01:25:51.197265+0000","last_fullsized":"2026-02-13T01:25:51.197265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:58.954207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196193+0000","last_change":"2026-02-13T01:25:36.134992+0000","last_active":"2026-02-13T01:25:51.196193+0000","last_peered":"2026-02-13T01:25:51.196193+0000","last_clean":"2026-02-13T01:25:51.196193+0000","last_became_active":"2026-02-13T01:25:36.133521+0000","last_became_peered":"2026-02-13T01:25:36.133521+0000","last_unstale":"2026-02-13T01:25:51.196193+0000","last_undegraded":"2026-02-13T01:25:51.196193+0000","last_fullsized":"2026-02-13T01:25:51.196193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:47:58.458458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198259+0000","last_change":"2026-02-13T01:25:36.150148+0000","last_active":"2026-02-13T01:25:51.198259+0000","last_peered":"2026-02-13T01:25:51.198259+0000","last_clean":"2026-02-13T01:25:51.198259+0000","last_became_active":"2026-02-13T01:25:36.149932+0000","last_became_peered":"2026-02-13T01:25:36.149932+0000","last_unstale":"2026-02-13T01:25:51.198259+0000","last_undegraded":"2026-02-13T01:25:51.198259+0000","last_fullsized":"2026-02-13T01:25:51.198259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:49:30.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197020+0000","last_change":"2026-02-13T01:25:36.138528+0000","last_active":"2026-02-13T01:25:51.197020+0000","last_peered":"2026-02-13T01:25:51.197020+0000","last_clean":"2026-02-13T01:25:51.197020+0000","last_became_active":"2026-02-13T01:25:36.138175+0000","last_became_peered":"2026-02-13T01:25:36.138175+0000","last_unstale":"2026-02-13T01:25:51.197020+0000","last_undegraded":"2026-02-13T01:25:51.197020+0000","last_fullsized":"2026-02-13T01:25:51.197020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:03.131535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313927+0000","last_change":"2026-02-13T01:25:36.139488+0000","last_active":"2026-02-13T01:25:51.313927+0000","last_peered":"2026-02-13T01:25:51.313927+0000","last_clean":"2026-02-13T01:25:51.313927+0000","last_became_active":"2026-02-13T01:25:36.139243+0000","last_became_peered":"2026-02-13T01:25:36.139243+0000","last_unstale":"2026-02-13T01:25:51.313927+0000","last_undegraded":"2026-02-13T01:25:51.313927+0000","last_fullsized":"2026-02-13T01:25:51.313927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:20:02.623867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198720+0000","last_change":"2026-02-13T01:25:36.148236+0000","last_active":"2026-02-13T01:25:51.198720+0000","last_peered":"2026-02-13T01:25:51.198720+0000","last_clean":"2026-02-13T01:25:51.198720+0000","last_became_active":"2026-02-13T01:25:36.148048+0000","last_became_peered":"2026-02-13T01:25:36.148048+0000","last_unstale":"2026-02-13T01:25:51.198720+0000","last_undegraded":"2026-02-13T01:25:51.198720+0000","last_fullsized":"2026-02-13T01:25:51.198720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:40.666362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195760+0000","last_change":"2026-02-13T01:25:36.143797+0000","last_active":"2026-02-13T01:25:51.195760+0000","last_peered":"2026-02-13T01:25:51.195760+0000","last_clean":"2026-02-13T01:25:51.195760+0000","last_became_active":"2026-02-13T01:25:36.143661+0000","last_became_peered":"2026-02-13T01:25:36.143661+0000","last_unstale":"2026-02-13T01:25:51.195760+0000","last_undegraded":"2026-02-13T01:25:51.195760+0000","last_fullsized":"2026-02-13T01:25:51.195760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:04:48.456593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196129+0000","last_change":"2026-02-13T01:25:36.142227+0000","last_active":"2026-02-13T01:25:51.196129+0000","last_peered":"2026-02-13T01:25:51.196129+0000","last_clean":"2026-02-13T01:25:51.196129+0000","last_became_active":"2026-02-13T01:25:36.142051+0000","last_became_peered":"2026-02-13T01:25:36.142051+0000","last_unstale":"2026-02-13T01:25:51.196129+0000","last_undegraded":"2026-02-13T01:25:51.196129+0000","last_fullsized":"2026-02-13T01:25:51.196129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:11.329213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196225+0000","last_change":"2026-02-13T01:25:36.148089+0000","last_active":"2026-02-13T01:25:51.196225+0000","last_peered":"2026-02-13T01:25:51.196225+0000","last_clean":"2026-02-13T01:25:51.196225+0000","last_became_active":"2026-02-13T01:25:36.147257+0000","last_became_peered":"2026-02-13T01:25:36.147257+0000","last_unstale":"2026-02-13T01:25:51.196225+0000","last_undegraded":"2026-02-13T01:25:51.196225+0000","last_fullsized":"2026-02-13T01:25:51.196225+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:40:59.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198417+0000","last_change":"2026-02-13T01:25:36.135766+0000","last_active":"2026-02-13T01:25:51.198417+0000","last_peered":"2026-02-13T01:25:51.198417+0000","last_clean":"2026-02-13T01:25:51.198417+0000","last_became_active":"2026-02-13T01:25:36.135558+0000","last_became_peered":"2026-02-13T01:25:36.135558+0000","last_unstale":"2026-02-13T01:25:51.198417+0000","last_undegraded":"2026-02-13T01:25:51.198417+0000","last_fullsized":"2026-02-13T01:25:51.198417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:57.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197240+0000","last_change":"2026-02-13T01:25:36.138886+0000","last_active":"2026-02-13T01:25:51.197240+0000","last_peered":"2026-02-13T01:25:51.197240+0000","last_clean":"2026-02-13T01:25:51.197240+0000","last_became_active":"2026-02-13T01:25:36.138137+0000","last_became_peered":"2026-02-13T01:25:36.138137+0000","last_unstale":"2026-02-13T01:25:51.197240+0000","last_undegraded":"2026-02-13T01:25:51.197240+0000","last_fullsized":"2026-02-13T01:25:51.197240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:27:45.807498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313752+0000","last_change":"2026-02-13T01:25:36.135480+0000","last_active":"2026-02-13T01:25:51.313752+0000","last_peered":"2026-02-13T01:25:51.313752+0000","last_clean":"2026-02-13T01:25:51.313752+0000","last_became_active":"2026-02-13T01:25:36.135317+0000","last_became_peered":"2026-02-13T01:25:36.135317+0000","last_unstale":"2026-02-13T01:25:51.313752+0000","last_undegraded":"2026-02-13T01:25:51.313752+0000","last_fullsized":"2026-02-13T01:25:51.313752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:53.115601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198382+0000","last_change":"2026-02-13T01:25:36.142116+0000","last_active":"2026-02-13T01:25:51.198382+0000","last_peered":"2026-02-13T01:25:51.198382+0000","last_clean":"2026-02-13T01:25:51.198382+0000","last_became_active":"2026-02-13T01:25:36.141991+0000","last_became_peered":"2026-02-13T01:25:36.141991+0000","last_unstale":"2026-02-13T01:25:51.198382+0000","last_undegraded":"2026-02-13T01:25:51.198382+0000","last_fullsized":"2026-02-13T01:25:51.198382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:56:25.382559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198114+0000","last_change":"2026-02-13T01:25:36.148870+0000","last_active":"2026-02-13T01:25:51.198114+0000","last_peered":"2026-02-13T01:25:51.198114+0000","last_clean":"2026-02-13T01:25:51.198114+0000","last_became_active":"2026-02-13T01:25:36.148711+0000","last_became_peered":"2026-02-13T01:25:36.148711+0000","last_unstale":"2026-02-13T01:25:51.198114+0000","last_undegraded":"2026-02-13T01:25:51.198114+0000","last_fullsized":"2026-02-13T01:25:51.198114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:19.690906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198181+0000","last_change":"2026-02-13T01:25:36.137587+0000","last_active":"2026-02-13T01:25:51.198181+0000","last_peered":"2026-02-13T01:25:51.198181+0000","last_clean":"2026-02-13T01:25:51.198181+0000","last_became_active":"2026-02-13T01:25:36.137466+0000","last_became_peered":"2026-02-13T01:25:36.137466+0000","last_unstale":"2026-02-13T01:25:51.198181+0000","last_undegraded":"2026-02-13T01:25:51.198181+0000","last_fullsized":"2026-02-13T01:25:51.198181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:33:59.319005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196978+0000","last_change":"2026-02-13T01:25:36.139743+0000","last_active":"2026-02-13T01:25:51.196978+0000","last_peered":"2026-02-13T01:25:51.196978+0000","last_clean":"2026-02-13T01:25:51.196978+0000","last_became_active":"2026-02-13T01:25:36.139485+0000","last_became_peered":"2026-02-13T01:25:36.139485+0000","last_unstale":"2026-02-13T01:25:51.196978+0000","last_undegraded":"2026-02-13T01:25:51.196978+0000","last_fullsized":"2026-02-13T01:25:51.196978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:58:32.872606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198516+0000","last_change":"2026-02-13T01:25:36.136983+0000","last_active":"2026-02-13T01:25:51.198516+0000","last_peered":"2026-02-13T01:25:51.198516+0000","last_clean":"2026-02-13T01:25:51.198516+0000","last_became_active":"2026-02-13T01:25:36.136763+0000","last_became_peered":"2026-02-13T01:25:36.136763+0000","last_unstale":"2026-02-13T01:25:51.198516+0000","last_undegraded":"2026-02-13T01:25:51.198516+0000","last_fullsized":"2026-02-13T01:25:51.198516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:40:56.832378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":42,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.884918+0000","last_change":"2026-02-13T01:25:35.135241+0000","last_active":"2026-02-13T01:25:51.884918+0000","last_peered":"2026-02-13T01:25:51.884918+0000","last_clean":"2026-02-13T01:25:51.884918+0000","last_became_active":"2026-02-13T01:25:35.134899+0000","last_became_peered":"2026-02-13T01:25:35.134899+0000","last_unstale":"2026-02-13T01:25:51.884918+0000","last_undegraded":"2026-02-13T01:25:51.884918+0000","last_fullsized":"2026-02-13T01:25:51.884918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:07.855253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.199322+0000","last_change":"2026-02-13T01:25:51.199266+0000","last_active":"2026-02-13T01:25:51.199322+0000","last_peered":"2026-02-13T01:25:51.199322+0000","last_clean":"2026-02-13T01:25:51.199322+0000","last_became_active":"2026-02-13T01:25:51.199062+0000","last_became_peered":"2026-02-13T01:25:51.199062+0000","last_unstale":"2026-02-13T01:25:51.199322+0000","last_undegraded":"2026-02-13T01:25:51.199322+0000","last_fullsized":"2026-02-13T01:25:51.199322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:44:34.983118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196184+0000","last_change":"2026-02-13T01:25:35.136018+0000","last_active":"2026-02-13T01:25:51.196184+0000","last_peered":"2026-02-13T01:25:51.196184+0000","last_clean":"2026-02-13T01:25:51.196184+0000","last_became_active":"2026-02-13T01:25:35.135844+0000","last_became_peered":"2026-02-13T01:25:35.135844+0000","last_unstale":"2026-02-13T01:25:51.196184+0000","last_undegraded":"2026-02-13T01:25:51.196184+0000","last_fullsized":"2026-02-13T01:25:51.196184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:16:38.882754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313087+0000","last_change":"2026-02-13T01:25:35.137229+0000","last_active":"2026-02-13T01:25:51.313087+0000","last_peered":"2026-02-13T01:25:51.313087+0000","last_clean":"2026-02-13T01:25:51.313087+0000","last_became_active":"2026-02-13T01:25:35.137100+0000","last_became_peered":"2026-02-13T01:25:35.137100+0000","last_unstale":"2026-02-13T01:25:51.313087+0000","last_undegraded":"2026-02-13T01:25:51.313087+0000","last_fullsized":"2026-02-13T01:25:51.313087+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:15.971676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195297+0000","last_change":"2026-02-13T01:25:36.144317+0000","last_active":"2026-02-13T01:25:51.195297+0000","last_peered":"2026-02-13T01:25:51.195297+0000","last_clean":"2026-02-13T01:25:51.195297+0000","last_became_active":"2026-02-13T01:25:36.144183+0000","last_became_peered":"2026-02-13T01:25:36.144183+0000","last_unstale":"2026-02-13T01:25:51.195297+0000","last_undegraded":"2026-02-13T01:25:51.195297+0000","last_fullsized":"2026-02-13T01:25:51.195297+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196387+0000","last_change":"2026-02-13T01:25:35.134736+0000","last_active":"2026-02-13T01:25:51.196387+0000","last_peered":"2026-02-13T01:25:51.196387+0000","last_clean":"2026-02-13T01:25:51.196387+0000","last_became_active":"2026-02-13T01:25:35.133880+0000","last_became_peered":"2026-02-13T01:25:35.133880+0000","last_unstale":"2026-02-13T01:25:51.196387+0000","last_undegraded":"2026-02-13T01:25:51.196387+0000","last_fullsized":"2026-02-13T01:25:51.196387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:34.048510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.315445+0000","last_change":"2026-02-13T01:25:51.315410+0000","last_active":"2026-02-13T01:25:51.315445+0000","last_peered":"2026-02-13T01:25:51.315445+0000","last_clean":"2026-02-13T01:25:51.315445+0000","last_became_active":"2026-02-13T01:25:51.315276+0000","last_became_peered":"2026-02-13T01:25:51.315276+0000","last_unstale":"2026-02-13T01:25:51.315445+0000","last_undegraded":"2026-02-13T01:25:51.315445+0000","last_fullsized":"2026-02-13T01:25:51.315445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:33.494620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:55.886667+0000","last_change":"2026-02-13T01:25:35.133950+0000","last_active":"2026-02-13T01:25:55.886667+0000","last_peered":"2026-02-13T01:25:55.886667+0000","last_clean":"2026-02-13T01:25:55.886667+0000","last_became_active":"2026-02-13T01:25:35.133719+0000","last_became_peered":"2026-02-13T01:25:35.133719+0000","last_unstale":"2026-02-13T01:25:55.886667+0000","last_undegraded":"2026-02-13T01:25:55.886667+0000","last_fullsized":"2026-02-13T01:25:55.886667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:02.337532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198909+0000","last_change":"2026-02-13T01:25:36.135519+0000","last_active":"2026-02-13T01:25:51.198909+0000","last_peered":"2026-02-13T01:25:51.198909+0000","last_clean":"2026-02-13T01:25:51.198909+0000","last_became_active":"2026-02-13T01:25:36.135164+0000","last_became_peered":"2026-02-13T01:25:36.135164+0000","last_unstale":"2026-02-13T01:25:51.198909+0000","last_undegraded":"2026-02-13T01:25:51.198909+0000","last_fullsized":"2026-02-13T01:25:51.198909+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:56:29.412112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197596+0000","last_change":"2026-02-13T01:25:35.133589+0000","last_active":"2026-02-13T01:25:51.197596+0000","last_peered":"2026-02-13T01:25:51.197596+0000","last_clean":"2026-02-13T01:25:51.197596+0000","last_became_active":"2026-02-13T01:25:35.133459+0000","last_became_peered":"2026-02-13T01:25:35.133459+0000","last_unstale":"2026-02-13T01:25:51.197596+0000","last_undegraded":"2026-02-13T01:25:51.197596+0000","last_fullsized":"2026-02-13T01:25:51.197596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:09.249742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198640+0000","last_change":"2026-02-13T01:25:51.198614+0000","last_active":"2026-02-13T01:25:51.198640+0000","last_peered":"2026-02-13T01:25:51.198640+0000","last_clean":"2026-02-13T01:25:51.198640+0000","last_became_active":"2026-02-13T01:25:51.198509+0000","last_became_peered":"2026-02-13T01:25:51.198509+0000","last_unstale":"2026-02-13T01:25:51.198640+0000","last_undegraded":"2026-02-13T01:25:51.198640+0000","last_fullsized":"2026-02-13T01:25:51.198640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:38:06.081050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196506+0000","last_change":"2026-02-13T01:25:35.142247+0000","last_active":"2026-02-13T01:25:51.196506+0000","last_peered":"2026-02-13T01:25:51.196506+0000","last_clean":"2026-02-13T01:25:51.196506+0000","last_became_active":"2026-02-13T01:25:35.142110+0000","last_became_peered":"2026-02-13T01:25:35.142110+0000","last_unstale":"2026-02-13T01:25:51.196506+0000","last_undegraded":"2026-02-13T01:25:51.196506+0000","last_fullsized":"2026-02-13T01:25:51.196506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:04.314916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198813+0000","last_change":"2026-02-13T01:25:36.136294+0000","last_active":"2026-02-13T01:25:51.198813+0000","last_peered":"2026-02-13T01:25:51.198813+0000","last_clean":"2026-02-13T01:25:51.198813+0000","last_became_active":"2026-02-13T01:25:36.135951+0000","last_became_peered":"2026-02-13T01:25:36.135951+0000","last_unstale":"2026-02-13T01:25:51.198813+0000","last_undegraded":"2026-02-13T01:25:51.198813+0000","last_fullsized":"2026-02-13T01:25:51.198813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:39.542560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'27","reported_seq":88,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:56.890367+0000","last_change":"2026-02-13T01:25:35.133772+0000","last_active":"2026-02-13T01:25:56.890367+0000","last_peered":"2026-02-13T01:25:56.890367+0000","last_clean":"2026-02-13T01:25:56.890367+0000","last_became_active":"2026-02-13T01:25:35.133563+0000","last_became_peered":"2026-02-13T01:25:35.133563+0000","last_unstale":"2026-02-13T01:25:56.890367+0000","last_undegraded":"2026-02-13T01:25:56.890367+0000","last_fullsized":"2026-02-13T01:25:56.890367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:14.216672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67062,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":84,"num_write":28,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198579+0000","last_change":"2026-02-13T01:25:36.135959+0000","last_active":"2026-02-13T01:25:51.198579+0000","last_peered":"2026-02-13T01:25:51.198579+0000","last_clean":"2026-02-13T01:25:51.198579+0000","last_became_active":"2026-02-13T01:25:36.135784+0000","last_became_peered":"2026-02-13T01:25:36.135784+0000","last_unstale":"2026-02-13T01:25:51.198579+0000","last_undegraded":"2026-02-13T01:25:51.198579+0000","last_fullsized":"2026-02-13T01:25:51.198579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:01.427696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198199+0000","last_change":"2026-02-13T01:25:35.135204+0000","last_active":"2026-02-13T01:25:51.198199+0000","last_peered":"2026-02-13T01:25:51.198199+0000","last_clean":"2026-02-13T01:25:51.198199+0000","last_became_active":"2026-02-13T01:25:35.135069+0000","last_became_peered":"2026-02-13T01:25:35.135069+0000","last_unstale":"2026-02-13T01:25:51.198199+0000","last_undegraded":"2026-02-13T01:25:51.198199+0000","last_fullsized":"2026-02-13T01:25:51.198199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:09.987226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313427+0000","last_change":"2026-02-13T01:25:36.146925+0000","last_active":"2026-02-13T01:25:51.313427+0000","last_peered":"2026-02-13T01:25:51.313427+0000","last_clean":"2026-02-13T01:25:51.313427+0000","last_became_active":"2026-02-13T01:25:36.146652+0000","last_became_peered":"2026-02-13T01:25:36.146652+0000","last_unstale":"2026-02-13T01:25:51.313427+0000","last_undegraded":"2026-02-13T01:25:51.313427+0000","last_fullsized":"2026-02-13T01:25:51.313427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:40.089890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196207+0000","last_change":"2026-02-13T01:25:35.134414+0000","last_active":"2026-02-13T01:25:51.196207+0000","last_peered":"2026-02-13T01:25:51.196207+0000","last_clean":"2026-02-13T01:25:51.196207+0000","last_became_active":"2026-02-13T01:25:35.134183+0000","last_became_peered":"2026-02-13T01:25:35.134183+0000","last_unstale":"2026-02-13T01:25:51.196207+0000","last_undegraded":"2026-02-13T01:25:51.196207+0000","last_fullsized":"2026-02-13T01:25:51.196207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:10:30.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197380+0000","last_change":"2026-02-13T01:25:36.136285+0000","last_active":"2026-02-13T01:25:51.197380+0000","last_peered":"2026-02-13T01:25:51.197380+0000","last_clean":"2026-02-13T01:25:51.197380+0000","last_became_active":"2026-02-13T01:25:36.136041+0000","last_became_peered":"2026-02-13T01:25:36.136041+0000","last_unstale":"2026-02-13T01:25:51.197380+0000","last_undegraded":"2026-02-13T01:25:51.197380+0000","last_fullsized":"2026-02-13T01:25:51.197380+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:29.618081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:53.892037+0000","last_change":"2026-02-13T01:25:35.130176+0000","last_active":"2026-02-13T01:25:53.892037+0000","last_peered":"2026-02-13T01:25:53.892037+0000","last_clean":"2026-02-13T01:25:53.892037+0000","last_became_active":"2026-02-13T01:25:35.129936+0000","last_became_peered":"2026-02-13T01:25:35.129936+0000","last_unstale":"2026-02-13T01:25:53.892037+0000","last_undegraded":"2026-02-13T01:25:53.892037+0000","last_fullsized":"2026-02-13T01:25:53.892037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:19:02.882229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197172+0000","last_change":"2026-02-13T01:25:36.139038+0000","last_active":"2026-02-13T01:25:51.197172+0000","last_peered":"2026-02-13T01:25:51.197172+0000","last_clean":"2026-02-13T01:25:51.197172+0000","last_became_active":"2026-02-13T01:25:36.138907+0000","last_became_peered":"2026-02-13T01:25:36.138907+0000","last_unstale":"2026-02-13T01:25:51.197172+0000","last_undegraded":"2026-02-13T01:25:51.197172+0000","last_fullsized":"2026-02-13T01:25:51.197172+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:56:47.023669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198386+0000","last_change":"2026-02-13T01:25:35.141943+0000","last_active":"2026-02-13T01:25:51.198386+0000","last_peered":"2026-02-13T01:25:51.198386+0000","last_clean":"2026-02-13T01:25:51.198386+0000","last_became_active":"2026-02-13T01:25:35.141823+0000","last_became_peered":"2026-02-13T01:25:35.141823+0000","last_unstale":"2026-02-13T01:25:51.198386+0000","last_undegraded":"2026-02-13T01:25:51.198386+0000","last_fullsized":"2026-02-13T01:25:51.198386+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:51:49.628611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196184+0000","last_change":"2026-02-13T01:25:36.137376+0000","last_active":"2026-02-13T01:25:51.196184+0000","last_peered":"2026-02-13T01:25:51.196184+0000","last_clean":"2026-02-13T01:25:51.196184+0000","last_became_active":"2026-02-13T01:25:36.137233+0000","last_became_peered":"2026-02-13T01:25:36.137233+0000","last_unstale":"2026-02-13T01:25:51.196184+0000","last_undegraded":"2026-02-13T01:25:51.196184+0000","last_fullsized":"2026-02-13T01:25:51.196184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:23.265090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198688+0000","last_change":"2026-02-13T01:25:35.134738+0000","last_active":"2026-02-13T01:25:51.198688+0000","last_peered":"2026-02-13T01:25:51.198688+0000","last_clean":"2026-02-13T01:25:51.198688+0000","last_became_active":"2026-02-13T01:25:35.134230+0000","last_became_peered":"2026-02-13T01:25:35.134230+0000","last_unstale":"2026-02-13T01:25:51.198688+0000","last_undegraded":"2026-02-13T01:25:51.198688+0000","last_fullsized":"2026-02-13T01:25:51.198688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:01.549908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198624+0000","last_change":"2026-02-13T01:25:51.198573+0000","last_active":"2026-02-13T01:25:51.198624+0000","last_peered":"2026-02-13T01:25:51.198624+0000","last_clean":"2026-02-13T01:25:51.198624+0000","last_became_active":"2026-02-13T01:25:51.198394+0000","last_became_peered":"2026-02-13T01:25:51.198394+0000","last_unstale":"2026-02-13T01:25:51.198624+0000","last_undegraded":"2026-02-13T01:25:51.198624+0000","last_fullsized":"2026-02-13T01:25:51.198624+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:35:01.400413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7],"acting":[11,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313698+0000","last_change":"2026-02-13T01:25:35.134452+0000","last_active":"2026-02-13T01:25:51.313698+0000","last_peered":"2026-02-13T01:25:51.313698+0000","last_clean":"2026-02-13T01:25:51.313698+0000","last_became_active":"2026-02-13T01:25:35.134356+0000","last_became_peered":"2026-02-13T01:25:35.134356+0000","last_unstale":"2026-02-13T01:25:51.313698+0000","last_undegraded":"2026-02-13T01:25:51.313698+0000","last_fullsized":"2026-02-13T01:25:51.313698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:13:15.661146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197629+0000","last_change":"2026-02-13T01:25:36.136496+0000","last_active":"2026-02-13T01:25:51.197629+0000","last_peered":"2026-02-13T01:25:51.197629+0000","last_clean":"2026-02-13T01:25:51.197629+0000","last_became_active":"2026-02-13T01:25:36.136326+0000","last_became_peered":"2026-02-13T01:25:36.136326+0000","last_unstale":"2026-02-13T01:25:51.197629+0000","last_undegraded":"2026-02-13T01:25:51.197629+0000","last_fullsized":"2026-02-13T01:25:51.197629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:16.478149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196547+0000","last_change":"2026-02-13T01:25:35.136719+0000","last_active":"2026-02-13T01:25:51.196547+0000","last_peered":"2026-02-13T01:25:51.196547+0000","last_clean":"2026-02-13T01:25:51.196547+0000","last_became_active":"2026-02-13T01:25:35.136582+0000","last_became_peered":"2026-02-13T01:25:35.136582+0000","last_unstale":"2026-02-13T01:25:51.196547+0000","last_undegraded":"2026-02-13T01:25:51.196547+0000","last_fullsized":"2026-02-13T01:25:51.196547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:08:34.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.200567+0000","last_change":"2026-02-13T01:25:51.200532+0000","last_active":"2026-02-13T01:25:51.200567+0000","last_peered":"2026-02-13T01:25:51.200567+0000","last_clean":"2026-02-13T01:25:51.200567+0000","last_became_active":"2026-02-13T01:25:51.198758+0000","last_became_peered":"2026-02-13T01:25:51.198758+0000","last_unstale":"2026-02-13T01:25:51.200567+0000","last_undegraded":"2026-02-13T01:25:51.200567+0000","last_fullsized":"2026-02-13T01:25:51.200567+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:50:38.228707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198298+0000","last_change":"2026-02-13T01:25:35.142342+0000","last_active":"2026-02-13T01:25:51.198298+0000","last_peered":"2026-02-13T01:25:51.198298+0000","last_clean":"2026-02-13T01:25:51.198298+0000","last_became_active":"2026-02-13T01:25:35.142181+0000","last_became_peered":"2026-02-13T01:25:35.142181+0000","last_unstale":"2026-02-13T01:25:51.198298+0000","last_undegraded":"2026-02-13T01:25:51.198298+0000","last_fullsized":"2026-02-13T01:25:51.198298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:55.874555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197485+0000","last_change":"2026-02-13T01:25:36.136500+0000","last_active":"2026-02-13T01:25:51.197485+0000","last_peered":"2026-02-13T01:25:51.197485+0000","last_clean":"2026-02-13T01:25:51.197485+0000","last_became_active":"2026-02-13T01:25:36.136320+0000","last_became_peered":"2026-02-13T01:25:36.136320+0000","last_unstale":"2026-02-13T01:25:51.197485+0000","last_undegraded":"2026-02-13T01:25:51.197485+0000","last_fullsized":"2026-02-13T01:25:51.197485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:02.843026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'152","reported_seq":343,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197351+0000","last_change":"2026-02-13T01:25:11.873663+0000","last_active":"2026-02-13T01:25:51.197351+0000","last_peered":"2026-02-13T01:25:51.197351+0000","last_clean":"2026-02-13T01:25:51.197351+0000","last_became_active":"2026-02-13T01:25:11.873388+0000","last_became_peered":"2026-02-13T01:25:11.873388+0000","last_unstale":"2026-02-13T01:25:51.197351+0000","last_undegraded":"2026-02-13T01:25:51.197351+0000","last_fullsized":"2026-02-13T01:25:51.197351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:58.300280+0000","last_clean_scrub_stamp":"2026-02-13T01:23:58.300280+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:10:54.389994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.627645+0000","last_change":"2026-02-13T01:25:35.132326+0000","last_active":"2026-02-13T01:25:51.627645+0000","last_peered":"2026-02-13T01:25:51.627645+0000","last_clean":"2026-02-13T01:25:51.627645+0000","last_became_active":"2026-02-13T01:25:35.132137+0000","last_became_peered":"2026-02-13T01:25:35.132137+0000","last_unstale":"2026-02-13T01:25:51.627645+0000","last_undegraded":"2026-02-13T01:25:51.627645+0000","last_fullsized":"2026-02-13T01:25:51.627645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:09.408356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196012+0000","last_change":"2026-02-13T01:25:36.139963+0000","last_active":"2026-02-13T01:25:51.196012+0000","last_peered":"2026-02-13T01:25:51.196012+0000","last_clean":"2026-02-13T01:25:51.196012+0000","last_became_active":"2026-02-13T01:25:36.139766+0000","last_became_peered":"2026-02-13T01:25:36.139766+0000","last_unstale":"2026-02-13T01:25:51.196012+0000","last_undegraded":"2026-02-13T01:25:51.196012+0000","last_fullsized":"2026-02-13T01:25:51.196012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:36:39.258718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197216+0000","last_change":"2026-02-13T01:25:35.133642+0000","last_active":"2026-02-13T01:25:51.197216+0000","last_peered":"2026-02-13T01:25:51.197216+0000","last_clean":"2026-02-13T01:25:51.197216+0000","last_became_active":"2026-02-13T01:25:35.133468+0000","last_became_peered":"2026-02-13T01:25:35.133468+0000","last_unstale":"2026-02-13T01:25:51.197216+0000","last_undegraded":"2026-02-13T01:25:51.197216+0000","last_fullsized":"2026-02-13T01:25:51.197216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:39:51.630278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313058+0000","last_change":"2026-02-13T01:25:36.134420+0000","last_active":"2026-02-13T01:25:51.313058+0000","last_peered":"2026-02-13T01:25:51.313058+0000","last_clean":"2026-02-13T01:25:51.313058+0000","last_became_active":"2026-02-13T01:25:36.134220+0000","last_became_peered":"2026-02-13T01:25:36.134220+0000","last_unstale":"2026-02-13T01:25:51.313058+0000","last_undegraded":"2026-02-13T01:25:51.313058+0000","last_fullsized":"2026-02-13T01:25:51.313058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:24.890803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.888030+0000","last_change":"2026-02-13T01:25:35.141639+0000","last_active":"2026-02-13T01:25:51.888030+0000","last_peered":"2026-02-13T01:25:51.888030+0000","last_clean":"2026-02-13T01:25:51.888030+0000","last_became_active":"2026-02-13T01:25:35.141170+0000","last_became_peered":"2026-02-13T01:25:35.141170+0000","last_unstale":"2026-02-13T01:25:51.888030+0000","last_undegraded":"2026-02-13T01:25:51.888030+0000","last_fullsized":"2026-02-13T01:25:51.888030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:00.460571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.317625+0000","last_change":"2026-02-13T01:25:51.317569+0000","last_active":"2026-02-13T01:25:51.317625+0000","last_peered":"2026-02-13T01:25:51.317625+0000","last_clean":"2026-02-13T01:25:51.317625+0000","last_became_active":"2026-02-13T01:25:51.317414+0000","last_became_peered":"2026-02-13T01:25:51.317414+0000","last_unstale":"2026-02-13T01:25:51.317625+0000","last_undegraded":"2026-02-13T01:25:51.317625+0000","last_fullsized":"2026-02-13T01:25:51.317625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:03:14.594804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197398+0000","last_change":"2026-02-13T01:25:35.135903+0000","last_active":"2026-02-13T01:25:51.197398+0000","last_peered":"2026-02-13T01:25:51.197398+0000","last_clean":"2026-02-13T01:25:51.197398+0000","last_became_active":"2026-02-13T01:25:35.135781+0000","last_became_peered":"2026-02-13T01:25:35.135781+0000","last_unstale":"2026-02-13T01:25:51.197398+0000","last_undegraded":"2026-02-13T01:25:51.197398+0000","last_fullsized":"2026-02-13T01:25:51.197398+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:53:03.733463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196345+0000","last_change":"2026-02-13T01:25:36.141427+0000","last_active":"2026-02-13T01:25:51.196345+0000","last_peered":"2026-02-13T01:25:51.196345+0000","last_clean":"2026-02-13T01:25:51.196345+0000","last_became_active":"2026-02-13T01:25:36.141212+0000","last_became_peered":"2026-02-13T01:25:36.141212+0000","last_unstale":"2026-02-13T01:25:51.196345+0000","last_undegraded":"2026-02-13T01:25:51.196345+0000","last_fullsized":"2026-02-13T01:25:51.196345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:08.651420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197327+0000","last_change":"2026-02-13T01:25:35.140365+0000","last_active":"2026-02-13T01:25:51.197327+0000","last_peered":"2026-02-13T01:25:51.197327+0000","last_clean":"2026-02-13T01:25:51.197327+0000","last_became_active":"2026-02-13T01:25:35.140102+0000","last_became_peered":"2026-02-13T01:25:35.140102+0000","last_unstale":"2026-02-13T01:25:51.197327+0000","last_undegraded":"2026-02-13T01:25:51.197327+0000","last_fullsized":"2026-02-13T01:25:51.197327+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:41.775450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196244+0000","last_change":"2026-02-13T01:25:36.149183+0000","last_active":"2026-02-13T01:25:51.196244+0000","last_peered":"2026-02-13T01:25:51.196244+0000","last_clean":"2026-02-13T01:25:51.196244+0000","last_became_active":"2026-02-13T01:25:36.149058+0000","last_became_peered":"2026-02-13T01:25:36.149058+0000","last_unstale":"2026-02-13T01:25:51.196244+0000","last_undegraded":"2026-02-13T01:25:51.196244+0000","last_fullsized":"2026-02-13T01:25:51.196244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:00:10.995137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198660+0000","last_change":"2026-02-13T01:25:35.142862+0000","last_active":"2026-02-13T01:25:51.198660+0000","last_peered":"2026-02-13T01:25:51.198660+0000","last_clean":"2026-02-13T01:25:51.198660+0000","last_became_active":"2026-02-13T01:25:35.142756+0000","last_became_peered":"2026-02-13T01:25:35.142756+0000","last_unstale":"2026-02-13T01:25:51.198660+0000","last_undegraded":"2026-02-13T01:25:51.198660+0000","last_fullsized":"2026-02-13T01:25:51.198660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:44.992379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.313776+0000","last_change":"2026-02-13T01:25:36.137479+0000","last_active":"2026-02-13T01:25:51.313776+0000","last_peered":"2026-02-13T01:25:51.313776+0000","last_clean":"2026-02-13T01:25:51.313776+0000","last_became_active":"2026-02-13T01:25:36.137017+0000","last_became_peered":"2026-02-13T01:25:36.137017+0000","last_unstale":"2026-02-13T01:25:51.313776+0000","last_undegraded":"2026-02-13T01:25:51.313776+0000","last_fullsized":"2026-02-13T01:25:51.313776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:16.874467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196232+0000","last_change":"2026-02-13T01:25:35.132546+0000","last_active":"2026-02-13T01:25:51.196232+0000","last_peered":"2026-02-13T01:25:51.196232+0000","last_clean":"2026-02-13T01:25:51.196232+0000","last_became_active":"2026-02-13T01:25:35.132444+0000","last_became_peered":"2026-02-13T01:25:35.132444+0000","last_unstale":"2026-02-13T01:25:51.196232+0000","last_undegraded":"2026-02-13T01:25:51.196232+0000","last_fullsized":"2026-02-13T01:25:51.196232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:32:38.653973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196352+0000","last_change":"2026-02-13T01:25:36.147093+0000","last_active":"2026-02-13T01:25:51.196352+0000","last_peered":"2026-02-13T01:25:51.196352+0000","last_clean":"2026-02-13T01:25:51.196352+0000","last_became_active":"2026-02-13T01:25:36.145890+0000","last_became_peered":"2026-02-13T01:25:36.145890+0000","last_unstale":"2026-02-13T01:25:51.196352+0000","last_undegraded":"2026-02-13T01:25:51.196352+0000","last_fullsized":"2026-02-13T01:25:51.196352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:54:22.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.627819+0000","last_change":"2026-02-13T01:25:35.138779+0000","last_active":"2026-02-13T01:25:51.627819+0000","last_peered":"2026-02-13T01:25:51.627819+0000","last_clean":"2026-02-13T01:25:51.627819+0000","last_became_active":"2026-02-13T01:25:35.138651+0000","last_became_peered":"2026-02-13T01:25:35.138651+0000","last_unstale":"2026-02-13T01:25:51.627819+0000","last_undegraded":"2026-02-13T01:25:51.627819+0000","last_fullsized":"2026-02-13T01:25:51.627819+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:32.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197934+0000","last_change":"2026-02-13T01:25:36.148055+0000","last_active":"2026-02-13T01:25:51.197934+0000","last_peered":"2026-02-13T01:25:51.197934+0000","last_clean":"2026-02-13T01:25:51.197934+0000","last_became_active":"2026-02-13T01:25:36.147694+0000","last_became_peered":"2026-02-13T01:25:36.147694+0000","last_unstale":"2026-02-13T01:25:51.197934+0000","last_undegraded":"2026-02-13T01:25:51.197934+0000","last_fullsized":"2026-02-13T01:25:51.197934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:51:10.233135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.202348+0000","last_change":"2026-02-13T01:25:51.202311+0000","last_active":"2026-02-13T01:25:51.202348+0000","last_peered":"2026-02-13T01:25:51.202348+0000","last_clean":"2026-02-13T01:25:51.202348+0000","last_became_active":"2026-02-13T01:25:51.201130+0000","last_became_peered":"2026-02-13T01:25:51.201130+0000","last_unstale":"2026-02-13T01:25:51.202348+0000","last_undegraded":"2026-02-13T01:25:51.202348+0000","last_fullsized":"2026-02-13T01:25:51.202348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:17.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198635+0000","last_change":"2026-02-13T01:25:36.137612+0000","last_active":"2026-02-13T01:25:51.198635+0000","last_peered":"2026-02-13T01:25:51.198635+0000","last_clean":"2026-02-13T01:25:51.198635+0000","last_became_active":"2026-02-13T01:25:36.137475+0000","last_became_peered":"2026-02-13T01:25:36.137475+0000","last_unstale":"2026-02-13T01:25:51.198635+0000","last_undegraded":"2026-02-13T01:25:51.198635+0000","last_fullsized":"2026-02-13T01:25:51.198635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:25.575818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195784+0000","last_change":"2026-02-13T01:25:35.133053+0000","last_active":"2026-02-13T01:25:51.195784+0000","last_peered":"2026-02-13T01:25:51.195784+0000","last_clean":"2026-02-13T01:25:51.195784+0000","last_became_active":"2026-02-13T01:25:35.132586+0000","last_became_peered":"2026-02-13T01:25:35.132586+0000","last_unstale":"2026-02-13T01:25:51.195784+0000","last_undegraded":"2026-02-13T01:25:51.195784+0000","last_fullsized":"2026-02-13T01:25:51.195784+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:43:01.503745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197024+0000","last_change":"2026-02-13T01:25:36.143686+0000","last_active":"2026-02-13T01:25:51.197024+0000","last_peered":"2026-02-13T01:25:51.197024+0000","last_clean":"2026-02-13T01:25:51.197024+0000","last_became_active":"2026-02-13T01:25:36.143525+0000","last_became_peered":"2026-02-13T01:25:36.143525+0000","last_unstale":"2026-02-13T01:25:51.197024+0000","last_undegraded":"2026-02-13T01:25:51.197024+0000","last_fullsized":"2026-02-13T01:25:51.197024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:40:04.527755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198130+0000","last_change":"2026-02-13T01:25:35.135384+0000","last_active":"2026-02-13T01:25:51.198130+0000","last_peered":"2026-02-13T01:25:51.198130+0000","last_clean":"2026-02-13T01:25:51.198130+0000","last_became_active":"2026-02-13T01:25:35.135072+0000","last_became_peered":"2026-02-13T01:25:35.135072+0000","last_unstale":"2026-02-13T01:25:51.198130+0000","last_undegraded":"2026-02-13T01:25:51.198130+0000","last_fullsized":"2026-02-13T01:25:51.198130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:52:12.046724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.195661+0000","last_change":"2026-02-13T01:25:36.140082+0000","last_active":"2026-02-13T01:25:51.195661+0000","last_peered":"2026-02-13T01:25:51.195661+0000","last_clean":"2026-02-13T01:25:51.195661+0000","last_became_active":"2026-02-13T01:25:36.139981+0000","last_became_peered":"2026-02-13T01:25:36.139981+0000","last_unstale":"2026-02-13T01:25:51.195661+0000","last_undegraded":"2026-02-13T01:25:51.195661+0000","last_fullsized":"2026-02-13T01:25:51.195661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:39:26.055432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198486+0000","last_change":"2026-02-13T01:25:35.134562+0000","last_active":"2026-02-13T01:25:51.198486+0000","last_peered":"2026-02-13T01:25:51.198486+0000","last_clean":"2026-02-13T01:25:51.198486+0000","last_became_active":"2026-02-13T01:25:35.134373+0000","last_became_peered":"2026-02-13T01:25:35.134373+0000","last_unstale":"2026-02-13T01:25:51.198486+0000","last_undegraded":"2026-02-13T01:25:51.198486+0000","last_fullsized":"2026-02-13T01:25:51.198486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:59:20.785594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.197389+0000","last_change":"2026-02-13T01:25:36.136492+0000","last_active":"2026-02-13T01:25:51.197389+0000","last_peered":"2026-02-13T01:25:51.197389+0000","last_clean":"2026-02-13T01:25:51.197389+0000","last_became_active":"2026-02-13T01:25:36.136356+0000","last_became_peered":"2026-02-13T01:25:36.136356+0000","last_unstale":"2026-02-13T01:25:51.197389+0000","last_undegraded":"2026-02-13T01:25:51.197389+0000","last_fullsized":"2026-02-13T01:25:51.197389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:37.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196421+0000","last_change":"2026-02-13T01:25:36.137223+0000","last_active":"2026-02-13T01:25:51.196421+0000","last_peered":"2026-02-13T01:25:51.196421+0000","last_clean":"2026-02-13T01:25:51.196421+0000","last_became_active":"2026-02-13T01:25:36.136594+0000","last_became_peered":"2026-02-13T01:25:36.136594+0000","last_unstale":"2026-02-13T01:25:51.196421+0000","last_undegraded":"2026-02-13T01:25:51.196421+0000","last_fullsized":"2026-02-13T01:25:51.196421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:06.793330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198751+0000","last_change":"2026-02-13T01:25:35.134717+0000","last_active":"2026-02-13T01:25:51.198751+0000","last_peered":"2026-02-13T01:25:51.198751+0000","last_clean":"2026-02-13T01:25:51.198751+0000","last_became_active":"2026-02-13T01:25:35.134328+0000","last_became_peered":"2026-02-13T01:25:35.134328+0000","last_unstale":"2026-02-13T01:25:51.198751+0000","last_undegraded":"2026-02-13T01:25:51.198751+0000","last_fullsized":"2026-02-13T01:25:51.198751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:06:06.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198791+0000","last_change":"2026-02-13T01:25:36.136474+0000","last_active":"2026-02-13T01:25:51.198791+0000","last_peered":"2026-02-13T01:25:51.198791+0000","last_clean":"2026-02-13T01:25:51.198791+0000","last_became_active":"2026-02-13T01:25:36.136113+0000","last_became_peered":"2026-02-13T01:25:36.136113+0000","last_unstale":"2026-02-13T01:25:51.198791+0000","last_undegraded":"2026-02-13T01:25:51.198791+0000","last_fullsized":"2026-02-13T01:25:51.198791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:16.502519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.200817+0000","last_change":"2026-02-13T01:25:51.200781+0000","last_active":"2026-02-13T01:25:51.200817+0000","last_peered":"2026-02-13T01:25:51.200817+0000","last_clean":"2026-02-13T01:25:51.200817+0000","last_became_active":"2026-02-13T01:25:51.198723+0000","last_became_peered":"2026-02-13T01:25:51.198723+0000","last_unstale":"2026-02-13T01:25:51.200817+0000","last_undegraded":"2026-02-13T01:25:51.200817+0000","last_fullsized":"2026-02-13T01:25:51.200817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:17:48.570275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196842+0000","last_change":"2026-02-13T01:25:36.144927+0000","last_active":"2026-02-13T01:25:51.196842+0000","last_peered":"2026-02-13T01:25:51.196842+0000","last_clean":"2026-02-13T01:25:51.196842+0000","last_became_active":"2026-02-13T01:25:36.143140+0000","last_became_peered":"2026-02-13T01:25:36.143140+0000","last_unstale":"2026-02-13T01:25:51.196842+0000","last_undegraded":"2026-02-13T01:25:51.196842+0000","last_fullsized":"2026-02-13T01:25:51.196842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:52:02.969954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196144+0000","last_change":"2026-02-13T01:25:35.141574+0000","last_active":"2026-02-13T01:25:51.196144+0000","last_peered":"2026-02-13T01:25:51.196144+0000","last_clean":"2026-02-13T01:25:51.196144+0000","last_became_active":"2026-02-13T01:25:35.141476+0000","last_became_peered":"2026-02-13T01:25:35.141476+0000","last_unstale":"2026-02-13T01:25:51.196144+0000","last_undegraded":"2026-02-13T01:25:51.196144+0000","last_fullsized":"2026-02-13T01:25:51.196144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:47.525668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.198389+0000","last_change":"2026-02-13T01:25:51.198350+0000","last_active":"2026-02-13T01:25:51.198389+0000","last_peered":"2026-02-13T01:25:51.198389+0000","last_clean":"2026-02-13T01:25:51.198389+0000","last_became_active":"2026-02-13T01:25:51.198226+0000","last_became_peered":"2026-02-13T01:25:51.198226+0000","last_unstale":"2026-02-13T01:25:51.198389+0000","last_undegraded":"2026-02-13T01:25:51.198389+0000","last_fullsized":"2026-02-13T01:25:51.198389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:35.123396+0000","last_clean_scrub_stamp":"2026-02-13T01:25:35.123396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:37:34.976137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:51.196192+0000","last_change":"2026-02-13T01:25:35.134773+0000","last_active":"2026-02-13T01:25:51.196192+0000","last_peered":"2026-02-13T01:25:51.196192+0000","last_clean":"2026-02-13T01:25:51.196192+0000","last_became_active":"2026-02-13T01:25:35.134296+0000","last_became_peered":"2026-02-13T01:25:35.134296+0000","last_unstale":"2026-02-13T01:25:51.196192+0000","last_undegraded":"2026-02-13T01:25:51.196192+0000","last_fullsized":"2026-02-13T01:25:51.196192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:34.121854+0000","last_clean_scrub_stamp":"2026-02-13T01:25:34.121854+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:15.209626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71148,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":118,"num_read_kb":133,"num_write":157,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":156061,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264763,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710730,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":398220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11406,"internal_metadata":27579250},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939660,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27928,"kb_used_data":964,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975272,"statfs":{"total":751619276800,"available":751590678528,"internally_reserved":0,"allocated":987136,"data_stored":1056763,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28798,"internal_metadata":27561858},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":398456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27005,"internal_metadata":27563651},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":398493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34359,"internal_metadata":27556297},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":990325,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":19597,"internal_metadata":27571059},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":397823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28371,"internal_metadata":27562285},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920789,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":989892,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33997,"internal_metadata":27556659},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051606,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":41,"kb_used_meta":26902,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42086,"internal_metadata":27548570},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280536,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":398134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49820,"internal_metadata":27540836},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27868,"kb_used_data":904,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975332,"statfs":{"total":751619276800,"available":751590739968,"internally_reserved":0,"allocated":925696,"data_stored":466460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60274,"internal_metadata":27530382},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640284,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":464678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46273,"internal_metadata":27544383},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771101,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":399138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47332,"internal_metadata":27543324},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36644,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38295,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2300,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33504,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30310,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11065,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4083,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2793,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8256,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18030,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12940,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23867,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7200,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:59.285 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T01:25:59.285 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T01:25:59.285 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T01:25:59.286 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:59.469 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:25:59.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/1055880619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d88115410 msgr2=0x7f4d88175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/1055880619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d88115410 0x7f4d88175db0 secure :-1 s=READY pgs=224 gs=3 cs=0 l=1 c_cookie=3037297773024980540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d7c00a9b0 tx=0x7f4d7c02fd60 comp rx=0 tx=0).stop 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/1055880619 shutdown_connections 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/1055880619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d88115410 0x7f4d88175db0 unknown :-1 s=CLOSED pgs=224 gs=3 cs=0 l=1 c_cookie=3037297773024980540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/1055880619 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d8810fbf0 0x7f4d88114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/1055880619 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d8810f200 0x7f4d8810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/1055880619 >> 10.20.193.28:0/1055880619 conn(0x7f4d880ecb00 msgr2=0x7f4d8810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/1055880619 shutdown_connections 2026-02-13T01:25:59.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.677+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/1055880619 wait complete. 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 Processor -- start 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 -- start start 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 0x7f4d8811d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d88115410 0x7f4d8811d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d88122a10 0x7f4d88122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88123420 con 0x7f4d8810f200 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88123590 con 0x7f4d88115410 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.678+0000 7f4d8e9c96c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88123750 con 0x7f4d88122a10 2026-02-13T01:25:59.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 0x7f4d8811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 0x7f4d8811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47862/0 (socket says 10.20.193.28:47862) 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 -- 10.20.193.28:0/3212886666 learned_addr learned my addr 10.20.193.28:0/3212886666 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d877fe6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d88115410 0x7f4d8811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 -- 10.20.193.28:0/3212886666 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d88122a10 msgr2=0x7f4d88122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d88122a10 0x7f4d88122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 -- 10.20.193.28:0/3212886666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d88115410 msgr2=0x7f4d8811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d88115410 0x7f4d8811d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 -- 10.20.193.28:0/3212886666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c00a5b0 con 0x7f4d8810f200 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d877fe6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d88115410 0x7f4d8811d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d87fff6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 0x7f4d8811d110 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d74009490 tx=0x7f4d7400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d74004a80 con 0x7f4d8810f200 2026-02-13T01:25:59.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d88163c00 con 0x7f4d8810f200 2026-02-13T01:25:59.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d88164090 con 0x7f4d8810f200 2026-02-13T01:25:59.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4d74009030 con 0x7f4d8810f200 2026-02-13T01:25:59.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.679+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d7400ce50 con 0x7f4d8810f200 2026-02-13T01:25:59.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.680+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d881104d0 con 0x7f4d8810f200 2026-02-13T01:25:59.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.682+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f4d74004ce0 con 0x7f4d8810f200 2026-02-13T01:25:59.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.684+0000 7f4d857fa6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4d5c0b5710 0x7f4d5c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.684+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f4d740e3d90 con 0x7f4d8810f200 2026-02-13T01:25:59.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.684+0000 7f4d877fe6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4d5c0b5710 0x7f4d5c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.684+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d740e4210 con 0x7f4d8810f200 2026-02-13T01:25:59.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.685+0000 7f4d877fe6c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4d5c0b5710 0x7f4d5c0d5bc0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d88123aa0 tx=0x7f4d78009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:59.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.809+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d8810f5d0 con 0x7f4d8810f200 2026-02-13T01:25:59.810 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:25:59 trial028 ceph-mon[22984]: pgmap v209: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 13 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:25:59.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.810+0000 7f4d857fa6c0 1 -- 10.20.193.28:0/3212886666 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d740a6690 con 0x7f4d8810f200 2026-02-13T01:25:59.811 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:25:59.811 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:59.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4d5c0b5710 msgr2=0x7f4d5c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4d5c0b5710 0x7f4d5c0d5bc0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d88123aa0 tx=0x7f4d78009310 comp rx=0 tx=0).stop 2026-02-13T01:25:59.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 msgr2=0x7f4d8811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 0x7f4d8811d110 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d74009490 tx=0x7f4d7400bc50 comp rx=0 tx=0).stop 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 shutdown_connections 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f4d5c0b5710 0x7f4d5c0d5bc0 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f4d88122a10 0x7f4d88122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f4d88115410 0x7f4d8811d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 --2- 10.20.193.28:0/3212886666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d8810f200 0x7f4d8811d110 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 >> 10.20.193.28:0/3212886666 conn(0x7f4d880ecb00 msgr2=0x7f4d8810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 shutdown_connections 2026-02-13T01:25:59.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:25:59.812+0000 7f4d8e9c96c0 1 -- 10.20.193.28:0/3212886666 wait complete. 2026-02-13T01:26:00.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:25:59 trial134 ceph-mon[27948]: pgmap v209: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 13 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:26:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:25:59 trial187 ceph-mon[27464]: pgmap v209: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 13 B/s, 1 keys/s, 0 objects/s recovering 2026-02-13T01:26:01.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:00 trial134 ceph-mon[27948]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:26:01.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:00 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3212886666' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:00 trial187 ceph-mon[27464]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:26:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:00 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3212886666' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:00 trial028 ceph-mon[22984]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:26:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:00 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3212886666' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:02.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:01 trial134 ceph-mon[27948]: pgmap v210: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:01 trial187 ceph-mon[27464]: pgmap v210: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:01 trial028 ceph-mon[22984]: pgmap v210: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 5 op/s; 11 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:02.916 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:03.102 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/1579217561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 msgr2=0x7faa740607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 --2- 10.20.193.28:0/1579217561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 0x7faa740607a0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=12608378647752898932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa64009970 tx=0x7faa6402ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/1579217561 shutdown_connections 2026-02-13T01:26:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 --2- 10.20.193.28:0/1579217561 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa74060ce0 0x7faa74061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 --2- 10.20.193.28:0/1579217561 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74159910 0x7faa74179cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 --2- 10.20.193.28:0/1579217561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 0x7faa740607a0 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=12608378647752898932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/1579217561 >> 10.20.193.28:0/1579217561 conn(0x7faa740ea6d0 msgr2=0x7faa7410aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/1579217561 shutdown_connections 2026-02-13T01:26:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/1579217561 wait complete. 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 Processor -- start 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.290+0000 7faa7b4d06c0 1 -- start start 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7b4d06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 0x7faa7405d600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7b4d06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 0x7faa7405db40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7b4d06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa74159910 0x7faa7416d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7b4d06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa7416d870 con 0x7faa740622d0 2026-02-13T01:26:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7b4d06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa7416d9e0 con 0x7faa74060ce0 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7b4d06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa7416dba0 con 0x7faa74159910 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 0x7faa7405d600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 0x7faa7405d600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:45130/0 (socket says 10.20.193.28:45130) 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 -- 10.20.193.28:0/943617896 learned_addr learned my addr 10.20.193.28:0/943617896 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa79ccd6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 0x7faa7405db40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7accf6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa74159910 0x7faa7416d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 -- 10.20.193.28:0/943617896 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa74159910 msgr2=0x7faa7416d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa74159910 0x7faa7416d220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 -- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 msgr2=0x7faa7405db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 0x7faa7405db40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 -- 10.20.193.28:0/943617896 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa64009590 con 0x7faa74060ce0 2026-02-13T01:26:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.291+0000 7faa7a4ce6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 0x7faa7405d600 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa64031fd0 tx=0x7faa6402fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.292+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa64002ae0 con 0x7faa74060ce0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.292+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faa64002c40 con 0x7faa74060ce0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.292+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/943617896 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7416de20 con 0x7faa74060ce0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.292+0000 7faa7b4d06c0 1 -- 10.20.193.28:0/943617896 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa74170730 con 0x7faa74060ce0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.292+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa640312b0 con 0x7faa74060ce0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.292+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa74061cb0 con 0x7faa74060ce0 2026-02-13T01:26:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.295+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7faa640077d0 con 0x7faa74060ce0 2026-02-13T01:26:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.296+0000 7faa5b7fe6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa500b5690 0x7faa500d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.296+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7faa64107d00 con 0x7faa74060ce0 2026-02-13T01:26:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.296+0000 7faa79ccd6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa500b5690 0x7faa500d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.296+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faa64108180 con 0x7faa74060ce0 2026-02-13T01:26:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.297+0000 7faa79ccd6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa500b5690 0x7faa500d5b40 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa741704a0 tx=0x7faa68009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:03.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.420+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa74061180 con 0x7faa74060ce0 2026-02-13T01:26:03.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.420+0000 7faa5b7fe6c0 1 -- 10.20.193.28:0/943617896 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faa74061180 con 0x7faa74060ce0 2026-02-13T01:26:03.421 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:03.421 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa500b5690 msgr2=0x7faa500d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa500b5690 0x7faa500d5b40 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa741704a0 tx=0x7faa68009260 comp rx=0 tx=0).stop 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 msgr2=0x7faa7405d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 0x7faa7405d600 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa64031fd0 tx=0x7faa6402fc70 comp rx=0 tx=0).stop 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 shutdown_connections 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa500b5690 0x7faa500d5b40 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa74159910 0x7faa7416d220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa740622d0 0x7faa7405db40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 --2- 10.20.193.28:0/943617896 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa74060ce0 0x7faa7405d600 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:03.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 >> 10.20.193.28:0/943617896 conn(0x7faa740ea6d0 msgr2=0x7faa7410aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:03.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.421+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 shutdown_connections 2026-02-13T01:26:03.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:03.422+0000 7faa597fa6c0 1 -- 10.20.193.28:0/943617896 wait complete. 2026-02-13T01:26:04.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:03 trial134 ceph-mon[27948]: pgmap v211: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:04.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:03 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/943617896' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:04.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:03 trial187 ceph-mon[27464]: pgmap v211: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:04.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:03 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/943617896' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:04.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:03 trial028 ceph-mon[22984]: pgmap v211: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s; 10 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:04.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:03 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/943617896' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:06.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:05 trial134 ceph-mon[27948]: pgmap v212: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:06.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:05 trial187 ceph-mon[27464]: pgmap v212: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:05 trial028 ceph-mon[22984]: pgmap v212: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:06.526 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:06.713 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/1658475938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 msgr2=0x7fb9d4175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/1658475938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d4175c10 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=8137646377092276158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9d000aa70 tx=0x7fb9d002fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/1658475938 shutdown_connections 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/1658475938 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb9d410fa50 0x7fb9d4114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/1658475938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d4175c10 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=8137646377092276158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/1658475938 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb9d410f060 0x7fb9d410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/1658475938 >> 10.20.193.28:0/1658475938 conn(0x7fb9d40ec980 msgr2=0x7fb9d410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.904+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/1658475938 shutdown_connections 2026-02-13T01:26:06.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.905+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/1658475938 wait complete. 2026-02-13T01:26:06.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.905+0000 7fb9dadd06c0 1 Processor -- start 2026-02-13T01:26:06.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.905+0000 7fb9dadd06c0 1 -- start start 2026-02-13T01:26:06.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9dadd06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb9d410f060 0x7fb9d411cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:06.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9dadd06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d411d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9dadd06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb9d4122860 0x7fb9d4122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9dadd06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d4123270 con 0x7fb9d4115270 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9dadd06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41233e0 con 0x7fb9d410f060 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9dadd06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41235a0 con 0x7fb9d4122860 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d411d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d411d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59750/0 (socket says 10.20.193.28:59750) 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9da5cf6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb9d4122860 0x7fb9d4122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 -- 10.20.193.28:0/324527984 learned_addr learned my addr 10.20.193.28:0/324527984 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d9dce6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb9d410f060 0x7fb9d411cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 -- 10.20.193.28:0/324527984 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb9d4122860 msgr2=0x7fb9d4122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb9d4122860 0x7fb9d4122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 -- 10.20.193.28:0/324527984 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb9d410f060 msgr2=0x7fb9d411cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb9d410f060 0x7fb9d411cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 -- 10.20.193.28:0/324527984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d000a660 con 0x7fb9d4115270 2026-02-13T01:26:06.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.906+0000 7fb9d95cd6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d411d4a0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9c800b6c0 tx=0x7fb9c800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:06.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.907+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9c8004250 con 0x7fb9d4115270 2026-02-13T01:26:06.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.907+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9c8009070 con 0x7fb9d4115270 2026-02-13T01:26:06.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.907+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9c800cd20 con 0x7fb9d4115270 2026-02-13T01:26:06.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.907+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d4163a50 con 0x7fb9d4115270 2026-02-13T01:26:06.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.907+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d4163ee0 con 0x7fb9d4115270 2026-02-13T01:26:06.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.907+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d4110330 con 0x7fb9d4115270 2026-02-13T01:26:06.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.909+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fb9c80028c0 con 0x7fb9d4115270 2026-02-13T01:26:06.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.911+0000 7fb9c2ffd6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9b00b5710 0x7fb9b00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:06.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.911+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fb9c80e3b00 con 0x7fb9d4115270 2026-02-13T01:26:06.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.911+0000 7fb9d9dce6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9b00b5710 0x7fb9b00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:06.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.911+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb9c811c5e0 con 0x7fb9d4115270 2026-02-13T01:26:06.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:06.912+0000 7fb9d9dce6c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9b00b5710 0x7fb9b00d5bc0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9c4004750 tx=0x7fb9c4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:07.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.038+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9d410f430 con 0x7fb9d4115270 2026-02-13T01:26:07.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.038+0000 7fb9c2ffd6c0 1 -- 10.20.193.28:0/324527984 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb9c80a6400 con 0x7fb9d4115270 2026-02-13T01:26:07.039 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:07.039 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9b00b5710 msgr2=0x7fb9b00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9b00b5710 0x7fb9b00d5bc0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9c4004750 tx=0x7fb9c4009390 comp rx=0 tx=0).stop 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 msgr2=0x7fb9d411d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d411d4a0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9c800b6c0 tx=0x7fb9c800bb90 comp rx=0 tx=0).stop 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 shutdown_connections 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9b00b5710 0x7fb9b00d5bc0 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:07.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fb9d4122860 0x7fb9d4122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9d4115270 0x7fb9d411d4a0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 --2- 10.20.193.28:0/324527984 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fb9d410f060 0x7fb9d411cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 >> 10.20.193.28:0/324527984 conn(0x7fb9d40ec980 msgr2=0x7fb9d410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.039+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 shutdown_connections 2026-02-13T01:26:07.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:07.040+0000 7fb9dadd06c0 1 -- 10.20.193.28:0/324527984 wait complete. 2026-02-13T01:26:08.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:07 trial134 ceph-mon[27948]: pgmap v213: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:08.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:07 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/324527984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:08.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:07 trial187 ceph-mon[27464]: pgmap v213: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:08.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:07 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/324527984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:08.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:07 trial028 ceph-mon[22984]: pgmap v213: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T01:26:08.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:07 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/324527984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:10.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:09 trial134 ceph-mon[27948]: pgmap v214: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 6 op/s 2026-02-13T01:26:10.143 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:10.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:09 trial187 ceph-mon[27464]: pgmap v214: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 6 op/s 2026-02-13T01:26:10.194 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:09 trial028 ceph-mon[22984]: pgmap v214: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 6 op/s 2026-02-13T01:26:10.329 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/3888476166 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 msgr2=0x7f7bd411b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/3888476166 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 0x7f7bd411b7c0 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=2801673954587369690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc0009970 tx=0x7f7bc002ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/3888476166 shutdown_connections 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/3888476166 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7bd41199a0 0x7f7bd4116df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/3888476166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd4118f30 0x7f7bd4119380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/3888476166 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 0x7f7bd411b7c0 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=2801673954587369690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/3888476166 >> 10.20.193.28:0/3888476166 conn(0x7f7bd405b290 msgr2=0x7f7bd405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/3888476166 shutdown_connections 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.532+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/3888476166 wait complete. 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 Processor -- start 2026-02-13T01:26:10.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 -- start start 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7bd4118f30 0x7f7bd40fdc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fe190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 0x7f7bd4103550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4103ba0 con 0x7f7bd41199a0 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4103d10 con 0x7f7bd411b3f0 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd91e36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd4103ed0 con 0x7f7bd4118f30 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fe190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fe190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59778/0 (socket says 10.20.193.28:59778) 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd3fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7bd4118f30 0x7f7bd40fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 -- 10.20.193.28:0/458047388 learned_addr learned my addr 10.20.193.28:0/458047388 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd89e26c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 0x7f7bd4103550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:10.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 -- 10.20.193.28:0/458047388 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7bd4118f30 msgr2=0x7f7bd40fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7bd4118f30 0x7f7bd40fdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 -- 10.20.193.28:0/458047388 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 msgr2=0x7f7bd4103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 0x7f7bd4103550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.533+0000 7f7bd37fe6c0 1 -- 10.20.193.28:0/458047388 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc40094c0 con 0x7f7bd41199a0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd37fe6c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fe190 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc400ba30 tx=0x7f7bc400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc4004250 con 0x7f7bd41199a0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bc4009070 con 0x7f7bd41199a0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc0009590 con 0x7f7bd41199a0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc400ce70 con 0x7f7bd41199a0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd41046c0 con 0x7f7bd41199a0 2026-02-13T01:26:10.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.534+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd405e670 con 0x7f7bd41199a0 2026-02-13T01:26:10.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.537+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f7bc40028c0 con 0x7f7bd41199a0 2026-02-13T01:26:10.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.538+0000 7f7bd17fa6c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7ba80b5750 0x7f7ba80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:10.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.539+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f7bc40e3c70 con 0x7f7bd41199a0 2026-02-13T01:26:10.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.539+0000 7f7bd3fff6c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7ba80b5750 0x7f7ba80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:10.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.539+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7bc40e40f0 con 0x7f7bd41199a0 2026-02-13T01:26:10.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.539+0000 7f7bd3fff6c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7ba80b5750 0x7f7ba80d5c00 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc00098c0 tx=0x7f7bc00023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:10.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.664+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7bd40feda0 con 0x7f7bd41199a0 2026-02-13T01:26:10.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.664+0000 7f7bd17fa6c0 1 -- 10.20.193.28:0/458047388 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7bc40a6600 con 0x7f7bd41199a0 2026-02-13T01:26:10.664 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:10.664 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7ba80b5750 msgr2=0x7f7ba80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7ba80b5750 0x7f7ba80d5c00 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc00098c0 tx=0x7f7bc00023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 msgr2=0x7f7bd40fe190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fe190 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc400ba30 tx=0x7f7bc400bf00 comp rx=0 tx=0).stop 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 shutdown_connections 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7bd411b3f0 0x7f7bd4103550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7bd41199a0 0x7f7bd40fe190 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7ba80b5750 0x7f7ba80d5c00 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 --2- 10.20.193.28:0/458047388 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7bd4118f30 0x7f7bd40fdc50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 >> 10.20.193.28:0/458047388 conn(0x7f7bd405b290 msgr2=0x7f7bd40f73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 shutdown_connections 2026-02-13T01:26:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:10.665+0000 7f7bd91e36c0 1 -- 10.20.193.28:0/458047388 wait complete. 2026-02-13T01:26:11.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:10 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/458047388' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:11.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:10 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/458047388' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:10 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/458047388' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:12.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:11 trial134 ceph-mon[27948]: pgmap v215: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2026-02-13T01:26:12.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:11 trial187 ceph-mon[27464]: pgmap v215: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2026-02-13T01:26:12.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:11 trial028 ceph-mon[22984]: pgmap v215: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2026-02-13T01:26:13.768 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:13.956 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:14.043 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:13 trial028 ceph-mon[22984]: pgmap v216: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2026-02-13T01:26:14.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:13 trial134 ceph-mon[27948]: pgmap v216: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2026-02-13T01:26:14.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:13 trial187 ceph-mon[27464]: pgmap v216: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/4172870737 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 msgr2=0x7fa314175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 --2- 10.20.193.28:0/4172870737 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa314175db0 secure :-1 s=READY pgs=104 gs=3 cs=0 l=1 c_cookie=2839706793207463470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa308006fd0 tx=0x7fa30802fd30 comp rx=0 tx=0).stop 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/4172870737 shutdown_connections 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 --2- 10.20.193.28:0/4172870737 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa314175db0 unknown :-1 s=CLOSED pgs=104 gs=3 cs=0 l=1 c_cookie=2839706793207463470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 --2- 10.20.193.28:0/4172870737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa31410fbf0 0x7fa314114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 --2- 10.20.193.28:0/4172870737 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa31410f200 0x7fa31410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/4172870737 >> 10.20.193.28:0/4172870737 conn(0x7fa3140ecb00 msgr2=0x7fa31410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:14.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/4172870737 shutdown_connections 2026-02-13T01:26:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.154+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/4172870737 wait complete. 2026-02-13T01:26:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 Processor -- start 2026-02-13T01:26:14.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 -- start start 2026-02-13T01:26:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa31410f200 0x7fa31411d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa31411d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3141229b0 0x7fa314122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:14.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141233c0 con 0x7fa3141229b0 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa314123530 con 0x7fa314115410 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31a3f96c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141236f0 con 0x7fa31410f200 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa3137fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa31411d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa3137fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa31411d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:39876/0 (socket says 10.20.193.28:39876) 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa3137fe6c0 1 -- 10.20.193.28:0/901671488 learned_addr learned my addr 10.20.193.28:0/901671488 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa313fff6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa31410f200 0x7fa31411d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa31896b6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3141229b0 0x7fa314122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa3137fe6c0 1 -- 10.20.193.28:0/901671488 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa31410f200 msgr2=0x7fa31411d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.155+0000 7fa3137fe6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa31410f200 0x7fa31411d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3137fe6c0 1 -- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3141229b0 msgr2=0x7fa314122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:14.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3137fe6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3141229b0 0x7fa314122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3137fe6c0 1 -- 10.20.193.28:0/901671488 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30800a5b0 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3137fe6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa31411d5f0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa30400b800 tx=0x7fa30400bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa304004a80 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa304009070 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa30400ce70 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/901671488 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa314163ba0 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa31a3f96c0 1 -- 10.20.193.28:0/901671488 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa314164030 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.156+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3141104d0 con 0x7fa314115410 2026-02-13T01:26:14.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.158+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fa304004070 con 0x7fa314115410 2026-02-13T01:26:14.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.160+0000 7fa3117fa6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2e80b5710 0x7fa2e80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:14.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.160+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fa3040e3c10 con 0x7fa314115410 2026-02-13T01:26:14.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.160+0000 7fa313fff6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2e80b5710 0x7fa2e80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:14.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.160+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa3040e4090 con 0x7fa314115410 2026-02-13T01:26:14.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.161+0000 7fa313fff6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2e80b5710 0x7fa2e80d5bc0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa300005b40 tx=0x7fa300009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:14.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.283+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa31411e200 con 0x7fa314115410 2026-02-13T01:26:14.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.284+0000 7fa3117fa6c0 1 -- 10.20.193.28:0/901671488 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa3040a6510 con 0x7fa314115410 2026-02-13T01:26:14.284 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:14.284 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:14.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2e80b5710 msgr2=0x7fa2e80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:14.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2e80b5710 0x7fa2e80d5bc0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa300005b40 tx=0x7fa300009310 comp rx=0 tx=0).stop 2026-02-13T01:26:14.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 msgr2=0x7fa31411d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:14.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa31411d5f0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa30400b800 tx=0x7fa30400bcd0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 shutdown_connections 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3141229b0 0x7fa314122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa314115410 0x7fa31411d5f0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa2e80b5710 0x7fa2e80d5bc0 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 --2- 10.20.193.28:0/901671488 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa31410f200 0x7fa31411d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 >> 10.20.193.28:0/901671488 conn(0x7fa3140ecb00 msgr2=0x7fa31410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 shutdown_connections 2026-02-13T01:26:14.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:14.285+0000 7fa2e6ffd6c0 1 -- 10.20.193.28:0/901671488 wait complete. 2026-02-13T01:26:15.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:14 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/901671488' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:14 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/901671488' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:14 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/901671488' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:16.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:15 trial134 ceph-mon[27948]: pgmap v217: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-13T01:26:16.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:15 trial028 ceph-mon[22984]: pgmap v217: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-13T01:26:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:15 trial187 ceph-mon[27464]: pgmap v217: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2026-02-13T01:26:17.389 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:17.576 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:17.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/1377274666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe03410fa50 msgr2=0x7fe034114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:17.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/1377274666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe03410fa50 0x7fe034114a90 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=16761118575478312607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe028009970 tx=0x7fe02802ed10 comp rx=0 tx=0).stop 2026-02-13T01:26:17.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/1377274666 shutdown_connections 2026-02-13T01:26:17.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/1377274666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe034115270 0x7fe034175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/1377274666 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe03410fa50 0x7fe034114a90 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=16761118575478312607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/1377274666 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe03410f060 0x7fe03410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/1377274666 >> 10.20.193.28:0/1377274666 conn(0x7fe0340ec980 msgr2=0x7fe03410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/1377274666 shutdown_connections 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.765+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/1377274666 wait complete. 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 Processor -- start 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 -- start start 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 0x7fe0340f4970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe034115270 0x7fe034175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:17.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe0340f4fa0 0x7fe0340fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340f5690 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340fa7b0 con 0x7fe0340f4fa0 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.766+0000 7fe03b46f6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340fa970 con 0x7fe034115270 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 0x7fe0340f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 0x7fe0340f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52538/0 (socket says 10.20.193.28:52538) 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 -- 10.20.193.28:0/425059074 learned_addr learned my addr 10.20.193.28:0/425059074 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe039c6c6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe034115270 0x7fe034175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 -- 10.20.193.28:0/425059074 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe034115270 msgr2=0x7fe034175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe034115270 0x7fe034175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 -- 10.20.193.28:0/425059074 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe0340f4fa0 msgr2=0x7fe0340fa270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe0340f4fa0 0x7fe0340fa270 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 -- 10.20.193.28:0/425059074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03000a5b0 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03a46d6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 0x7fe0340f4970 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe024009490 tx=0x7fe02400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe024004a80 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe024009030 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0240071c0 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe028009590 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.767+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0340faf50 con 0x7fe03410f060 2026-02-13T01:26:17.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.768+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe034110330 con 0x7fe03410f060 2026-02-13T01:26:17.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.770+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fe024005000 con 0x7fe03410f060 2026-02-13T01:26:17.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.772+0000 7fe01b7fe6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe0100b5690 0x7fe0100d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:17.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.772+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fe0240e3d50 con 0x7fe03410f060 2026-02-13T01:26:17.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.772+0000 7fe039c6c6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe0100b5690 0x7fe0100d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:17.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.772+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe0240e41d0 con 0x7fe03410f060 2026-02-13T01:26:17.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.772+0000 7fe039c6c6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe0100b5690 0x7fe0100d5b40 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0280023e0 tx=0x7fe028005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:17.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.897+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe0340f5b20 con 0x7fe03410f060 2026-02-13T01:26:17.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.897+0000 7fe01b7fe6c0 1 -- 10.20.193.28:0/425059074 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe0240a6650 con 0x7fe03410f060 2026-02-13T01:26:17.897 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:17.897 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.898+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe0100b5690 msgr2=0x7fe0100d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.898+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe0100b5690 0x7fe0100d5b40 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0280023e0 tx=0x7fe028005c60 comp rx=0 tx=0).stop 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.898+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 msgr2=0x7fe0340f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.898+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 0x7fe0340f4970 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe024009490 tx=0x7fe02400bc50 comp rx=0 tx=0).stop 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 shutdown_connections 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe0100b5690 0x7fe0100d5b40 unknown :-1 s=CLOSED pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe034115270 0x7fe034175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe0340f4fa0 0x7fe0340fa270 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 --2- 10.20.193.28:0/425059074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe03410f060 0x7fe0340f4970 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 >> 10.20.193.28:0/425059074 conn(0x7fe0340ec980 msgr2=0x7fe03410d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:17.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 shutdown_connections 2026-02-13T01:26:17.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:17.899+0000 7fe03b46f6c0 1 -- 10.20.193.28:0/425059074 wait complete. 2026-02-13T01:26:17.958 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:17 trial028 ceph-mon[22984]: pgmap v218: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T01:26:18.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:17 trial134 ceph-mon[27948]: pgmap v218: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T01:26:18.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:17 trial187 ceph-mon[27464]: pgmap v218: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T01:26:19.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:18 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/425059074' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:19.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:18 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/425059074' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:18 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/425059074' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:19 trial134 ceph-mon[27948]: pgmap v219: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 6 op/s 2026-02-13T01:26:20.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:19 trial187 ceph-mon[27464]: pgmap v219: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 6 op/s 2026-02-13T01:26:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:19 trial028 ceph-mon[22984]: pgmap v219: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 6 op/s 2026-02-13T01:26:21.000 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:21.186 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:21.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 -- 10.20.193.28:0/266157839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a901149c0 msgr2=0x7f2a90114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:21.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 --2- 10.20.193.28:0/266157839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a901149c0 0x7f2a90114ee0 secure :-1 s=READY pgs=231 gs=2 cs=0 l=1 c_cookie=2118480210053144533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a8c00aa40 tx=0x7f2a8c02fe00 comp rx=0 tx=0).stop 2026-02-13T01:26:21.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 -- 10.20.193.28:0/266157839 shutdown_connections 2026-02-13T01:26:21.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 --2- 10.20.193.28:0/266157839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a90113dc0 0x7f2a90114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 --2- 10.20.193.28:0/266157839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a901149c0 0x7f2a90114ee0 unknown :-1 s=CLOSED pgs=231 gs=2 cs=0 l=1 c_cookie=2118480210053144533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 --2- 10.20.193.28:0/266157839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a9011b510 0x7f2a9011b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.374+0000 7f2a983076c0 1 -- 10.20.193.28:0/266157839 >> 10.20.193.28:0/266157839 conn(0x7f2a90058a50 msgr2=0x7f2a90058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:21.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.375+0000 7f2a983076c0 1 -- 10.20.193.28:0/266157839 shutdown_connections 2026-02-13T01:26:21.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.375+0000 7f2a983076c0 1 -- 10.20.193.28:0/266157839 wait complete. 2026-02-13T01:26:21.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.375+0000 7f2a983076c0 1 Processor -- start 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.375+0000 7f2a983076c0 1 -- start start 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a983076c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 0x7f2a9012b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a983076c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a901149c0 0x7f2a9012bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a983076c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a9011b510 0x7f2a901310d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a983076c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90131720 con 0x7f2a9011b510 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a983076c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90131890 con 0x7f2a90113dc0 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a983076c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90131a50 con 0x7f2a901149c0 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a960786c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 0x7f2a9012b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a960786c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 0x7f2a9012b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:47608/0 (socket says 10.20.193.28:47608) 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a960786c0 1 -- 10.20.193.28:0/388948244 learned_addr learned my addr 10.20.193.28:0/388948244 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:21.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a901149c0 0x7f2a9012bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a968796c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a9011b510 0x7f2a901310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 -- 10.20.193.28:0/388948244 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 msgr2=0x7f2a9012b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 0x7f2a9012b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 -- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a9011b510 msgr2=0x7f2a901310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a9011b510 0x7f2a901310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 -- 10.20.193.28:0/388948244 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c00a660 con 0x7f2a901149c0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a960786c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 0x7f2a9012b7d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.376+0000 7f2a958776c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a901149c0 0x7f2a9012bd10 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a8400b6c0 tx=0x7f2a8400bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.377+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a84004240 con 0x7f2a901149c0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.377+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a84009030 con 0x7f2a901149c0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.377+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a90131d30 con 0x7f2a901149c0 2026-02-13T01:26:21.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.377+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a840036e0 con 0x7f2a901149c0 2026-02-13T01:26:21.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.377+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a90172410 con 0x7f2a901149c0 2026-02-13T01:26:21.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.377+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a90131f50 con 0x7f2a901149c0 2026-02-13T01:26:21.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.379+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f2a840038a0 con 0x7f2a901149c0 2026-02-13T01:26:21.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.381+0000 7f2a777fe6c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2a6c0b5690 0x7f2a6c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:21.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.381+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f2a840e3a50 con 0x7f2a901149c0 2026-02-13T01:26:21.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.381+0000 7f2a960786c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2a6c0b5690 0x7f2a6c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:21.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.381+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2a8411c5e0 con 0x7f2a901149c0 2026-02-13T01:26:21.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.382+0000 7f2a960786c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2a6c0b5690 0x7f2a6c0d5b40 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a800095e0 tx=0x7f2a80009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:21.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.505+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2a9012c920 con 0x7f2a901149c0 2026-02-13T01:26:21.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.506+0000 7f2a777fe6c0 1 -- 10.20.193.28:0/388948244 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2a840a6350 con 0x7f2a901149c0 2026-02-13T01:26:21.506 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:21.506 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:21.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2a6c0b5690 msgr2=0x7f2a6c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2a6c0b5690 0x7f2a6c0d5b40 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a800095e0 tx=0x7f2a80009260 comp rx=0 tx=0).stop 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a901149c0 msgr2=0x7f2a9012bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a901149c0 0x7f2a9012bd10 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a8400b6c0 tx=0x7f2a8400bb90 comp rx=0 tx=0).stop 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 shutdown_connections 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2a6c0b5690 0x7f2a6c0d5b40 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2a901149c0 0x7f2a9012bd10 unknown :-1 s=CLOSED pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a9011b510 0x7f2a901310d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 --2- 10.20.193.28:0/388948244 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2a90113dc0 0x7f2a9012b7d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 >> 10.20.193.28:0/388948244 conn(0x7f2a90058a50 msgr2=0x7f2a90119800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:21.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 shutdown_connections 2026-02-13T01:26:21.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:21.507+0000 7f2a983076c0 1 -- 10.20.193.28:0/388948244 wait complete. 2026-02-13T01:26:21.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:21 trial028 ceph-mon[22984]: pgmap v220: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:26:21.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:21 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/388948244' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:21 trial134 ceph-mon[27948]: pgmap v220: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:26:22.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:21 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/388948244' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:22.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:21 trial187 ceph-mon[27464]: pgmap v220: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:26:22.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:21 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/388948244' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:23 trial134 ceph-mon[27948]: pgmap v221: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:26:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:23 trial187 ceph-mon[27464]: pgmap v221: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:26:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:23 trial028 ceph-mon[22984]: pgmap v221: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:26:24.612 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:24.799 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 -- 10.20.193.28:0/2148570250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f745010f200 msgr2=0x7f745010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 --2- 10.20.193.28:0/2148570250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f745010f200 0x7f745010f5d0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=10136443605879316640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74400098d0 tx=0x7f744002ec40 comp rx=0 tx=0).stop 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 -- 10.20.193.28:0/2148570250 shutdown_connections 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 --2- 10.20.193.28:0/2148570250 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f745010fbf0 0x7f7450114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 --2- 10.20.193.28:0/2148570250 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7450115410 0x7f7450175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 --2- 10.20.193.28:0/2148570250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f745010f200 0x7f745010f5d0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=10136443605879316640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:24.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.996+0000 7f745772b6c0 1 -- 10.20.193.28:0/2148570250 >> 10.20.193.28:0/2148570250 conn(0x7f74500ecb00 msgr2=0x7f745010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:24.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.997+0000 7f745772b6c0 1 -- 10.20.193.28:0/2148570250 shutdown_connections 2026-02-13T01:26:24.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.997+0000 7f745772b6c0 1 -- 10.20.193.28:0/2148570250 wait complete. 2026-02-13T01:26:24.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.997+0000 7f745772b6c0 1 Processor -- start 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.997+0000 7f745772b6c0 1 -- start start 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745772b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 0x7f745011d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745772b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 0x7f745011d6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745772b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7450122aa0 0x7f7450122f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745772b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74501234b0 con 0x7f7450115410 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745772b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7450123620 con 0x7f745010f200 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745772b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f74501237e0 con 0x7f7450122aa0 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f7454c9b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 0x7f745011d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 0x7f745011d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:25.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f7454c9b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 0x7f745011d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52576/0 (socket says 10.20.193.28:52576) 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 0x7f745011d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:47628/0 (socket says 10.20.193.28:47628) 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f7454c9b6c0 1 -- 10.20.193.28:0/3218439008 learned_addr learned my addr 10.20.193.28:0/3218439008 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f7455c9d6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7450122aa0 0x7f7450122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 -- 10.20.193.28:0/3218439008 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7450122aa0 msgr2=0x7f7450122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7450122aa0 0x7f7450122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 -- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 msgr2=0x7f745011d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 0x7f745011d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 -- 10.20.193.28:0/3218439008 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74400094c0 con 0x7f745010f200 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f7454c9b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 0x7f745011d6e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f745549c6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 0x7f745011d1a0 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74400097f0 tx=0x7f744002fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.998+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74400045f0 con 0x7f745010f200 2026-02-13T01:26:25.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.999+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f74400071c0 con 0x7f745010f200 2026-02-13T01:26:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.999+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74400312b0 con 0x7f745010f200 2026-02-13T01:26:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.999+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7450163c30 con 0x7f745010f200 2026-02-13T01:26:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.999+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74501640b0 con 0x7f745010f200 2026-02-13T01:26:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:24.999+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74501104d0 con 0x7f745010f200 2026-02-13T01:26:25.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.001+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f7440002ae0 con 0x7f745010f200 2026-02-13T01:26:25.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.003+0000 7f743e7fc6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f742c0b5710 0x7f742c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:25.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.003+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f7440107d60 con 0x7f745010f200 2026-02-13T01:26:25.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.003+0000 7f7454c9b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f742c0b5710 0x7f742c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:25.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.003+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74401081e0 con 0x7f745010f200 2026-02-13T01:26:25.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.004+0000 7f7454c9b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f742c0b5710 0x7f742c0d5bc0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7450123b30 tx=0x7f7444009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:25.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.127+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f745010f5d0 con 0x7f745010f200 2026-02-13T01:26:25.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.128+0000 7f743e7fc6c0 1 -- 10.20.193.28:0/3218439008 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74400ca660 con 0x7f745010f200 2026-02-13T01:26:25.128 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:25.128 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:25.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f742c0b5710 msgr2=0x7f742c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f742c0b5710 0x7f742c0d5bc0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7450123b30 tx=0x7f7444009310 comp rx=0 tx=0).stop 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 msgr2=0x7f745011d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 0x7f745011d1a0 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74400097f0 tx=0x7f744002fba0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 shutdown_connections 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f742c0b5710 0x7f742c0d5bc0 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7450122aa0 0x7f7450122f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7450115410 0x7f745011d6e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 --2- 10.20.193.28:0/3218439008 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f745010f200 0x7f745011d1a0 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 >> 10.20.193.28:0/3218439008 conn(0x7f74500ecb00 msgr2=0x7f745010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 shutdown_connections 2026-02-13T01:26:25.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:25.129+0000 7f745772b6c0 1 -- 10.20.193.28:0/3218439008 wait complete. 2026-02-13T01:26:26.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:25 trial134 ceph-mon[27948]: pgmap v222: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:26.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:25 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3218439008' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:26.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:25 trial187 ceph-mon[27464]: pgmap v222: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:26.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:25 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3218439008' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:26.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:25 trial028 ceph-mon[22984]: pgmap v222: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:26.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:25 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3218439008' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:28.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:27 trial134 ceph-mon[27948]: pgmap v223: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:28.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:27 trial187 ceph-mon[27464]: pgmap v223: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:28.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:27 trial028 ceph-mon[22984]: pgmap v223: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:28.236 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:28.419 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:28.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3014355398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410fa50 msgr2=0x7f46a4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3014355398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410fa50 0x7f46a4114a90 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=6409320366400792863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46940098d0 tx=0x7f469402ec40 comp rx=0 tx=0).stop 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3014355398 shutdown_connections 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3014355398 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a4115270 0x7f46a4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3014355398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410fa50 0x7f46a4114a90 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=6409320366400792863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3014355398 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f46a410f060 0x7f46a410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3014355398 >> 10.20.193.28:0/3014355398 conn(0x7f46a40ec980 msgr2=0x7f46a410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3014355398 shutdown_connections 2026-02-13T01:26:28.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.629+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3014355398 wait complete. 2026-02-13T01:26:28.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 Processor -- start 2026-02-13T01:26:28.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 -- start start 2026-02-13T01:26:28.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 0x7f46a40f49a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f46a4115270 0x7f46a4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a40f4fd0 0x7f46a40fa2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40f56c0 con 0x7f46a410f060 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40fa7e0 con 0x7f46a40f4fd0 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.630+0000 7f46a8b566c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40fa9a0 con 0x7f46a4115270 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 0x7f46a40f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 0x7f46a40f49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48706/0 (socket says 10.20.193.28:48706) 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 -- 10.20.193.28:0/3106644440 learned_addr learned my addr 10.20.193.28:0/3106644440 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a2ffd6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f46a4115270 0x7f46a4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a3fff6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a40f4fd0 0x7f46a40fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 -- 10.20.193.28:0/3106644440 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f46a4115270 msgr2=0x7f46a4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:28.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f46a4115270 0x7f46a4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 -- 10.20.193.28:0/3106644440 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a40f4fd0 msgr2=0x7f46a40fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a40f4fd0 0x7f46a40fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 -- 10.20.193.28:0/3106644440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46940094c0 con 0x7f46a410f060 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a3fff6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a40f4fd0 0x7f46a40fa2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a37fe6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 0x7f46a40f49a0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4690005950 tx=0x7f469000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4690004460 con 0x7f46a410f060 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f46900045c0 con 0x7f46a410f060 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a40fac80 con 0x7f46a410f060 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4690003960 con 0x7f46a410f060 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.631+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a40fb110 con 0x7f46a410f060 2026-02-13T01:26:28.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.632+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a4110330 con 0x7f46a410f060 2026-02-13T01:26:28.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.634+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f46900050b0 con 0x7f46a410f060 2026-02-13T01:26:28.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.636+0000 7f46a0ff96c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f46780b5690 0x7f46780d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:28.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.636+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f46900e3a50 con 0x7f46a410f060 2026-02-13T01:26:28.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.636+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f469011c5e0 con 0x7f46a410f060 2026-02-13T01:26:28.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.636+0000 7f46a2ffd6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f46780b5690 0x7f46780d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:28.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.637+0000 7f46a2ffd6c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f46780b5690 0x7f46780d5b40 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46940097f0 tx=0x7f46940023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:28.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.759+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f46a40fb110 con 0x7f46a410f060 2026-02-13T01:26:28.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.760+0000 7f46a0ff96c0 1 -- 10.20.193.28:0/3106644440 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f46a40fb110 con 0x7f46a410f060 2026-02-13T01:26:28.760 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:28.760 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:28.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f46780b5690 msgr2=0x7f46780d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:28.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f46780b5690 0x7f46780d5b40 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46940097f0 tx=0x7f46940023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 msgr2=0x7f46a40f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:28.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 0x7f46a40f49a0 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4690005950 tx=0x7f469000bca0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 shutdown_connections 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f46780b5690 0x7f46780d5b40 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f46a4115270 0x7f46a4175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f46a40f4fd0 0x7f46a40fa2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 --2- 10.20.193.28:0/3106644440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46a410f060 0x7f46a40f49a0 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 >> 10.20.193.28:0/3106644440 conn(0x7f46a40ec980 msgr2=0x7f46a4113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 shutdown_connections 2026-02-13T01:26:28.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:28.761+0000 7f46a8b566c0 1 -- 10.20.193.28:0/3106644440 wait complete. 2026-02-13T01:26:29.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:28 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3106644440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:29.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:28 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3106644440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:29.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:28 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3106644440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:30.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:29 trial187 ceph-mon[27464]: pgmap v224: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:30.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:29 trial028 ceph-mon[22984]: pgmap v224: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:30.203 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:29 trial134 ceph-mon[27948]: pgmap v224: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:26:31.863 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:32.050 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:32.092 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:31 trial028 ceph-mon[22984]: pgmap v225: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:26:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:31 trial187 ceph-mon[27464]: pgmap v225: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:26:32.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/1344913790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c10fbf0 msgr2=0x7fcb7c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:32.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 --2- 10.20.193.28:0/1344913790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c10fbf0 0x7fcb7c114c30 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=5186126599069315984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb680098d0 tx=0x7fcb6802ec40 comp rx=0 tx=0).stop 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/1344913790 shutdown_connections 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 --2- 10.20.193.28:0/1344913790 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 --2- 10.20.193.28:0/1344913790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c10fbf0 0x7fcb7c114c30 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=5186126599069315984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 --2- 10.20.193.28:0/1344913790 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb7c10f200 0x7fcb7c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/1344913790 >> 10.20.193.28:0/1344913790 conn(0x7fcb7c0ecb00 msgr2=0x7fcb7c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/1344913790 shutdown_connections 2026-02-13T01:26:32.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.246+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/1344913790 wait complete. 2026-02-13T01:26:32.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 Processor -- start 2026-02-13T01:26:32.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 -- start start 2026-02-13T01:26:32.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb7c10f200 0x7fcb7c0f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:32.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:32.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c0f5140 0x7fcb7c0fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:32.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0f5830 con 0x7fcb7c0f5140 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0fa950 con 0x7fcb7c10f200 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb8487b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0fab10 con 0x7fcb7c115410 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb81deb6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb82ded6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c0f5140 0x7fcb7c0fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb81deb6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:36134/0 (socket says 10.20.193.28:36134) 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb81deb6c0 1 -- 10.20.193.28:0/2852408045 learned_addr learned my addr 10.20.193.28:0/2852408045 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.247+0000 7fcb825ec6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb7c10f200 0x7fcb7c0f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb82ded6c0 1 -- 10.20.193.28:0/2852408045 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 msgr2=0x7fcb7c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb82ded6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb82ded6c0 1 -- 10.20.193.28:0/2852408045 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb7c10f200 msgr2=0x7fcb7c0f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:32.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb82ded6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb7c10f200 0x7fcb7c0f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb82ded6c0 1 -- 10.20.193.28:0/2852408045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb680094c0 con 0x7fcb7c0f5140 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb81deb6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb82ded6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c0f5140 0x7fcb7c0fa410 secure :-1 s=READY pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb70006f60 tx=0x7fcb7000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb70003c40 con 0x7fcb7c0f5140 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcb70003da0 con 0x7fcb7c0f5140 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb7000de60 con 0x7fcb7c0f5140 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/2852408045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c0fadf0 con 0x7fcb7c0f5140 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.248+0000 7fcb8487b6c0 1 -- 10.20.193.28:0/2852408045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c0fb280 con 0x7fcb7c0f5140 2026-02-13T01:26:32.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.249+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c1104d0 con 0x7fcb7c0f5140 2026-02-13T01:26:32.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.251+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fcb70005030 con 0x7fcb7c0f5140 2026-02-13T01:26:32.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.252+0000 7fcb677fe6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb580b5700 0x7fcb580d5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:32.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.253+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fcb700e49e0 con 0x7fcb7c0f5140 2026-02-13T01:26:32.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.253+0000 7fcb825ec6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb580b5700 0x7fcb580d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:32.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.253+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb700e4e60 con 0x7fcb7c0f5140 2026-02-13T01:26:32.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.253+0000 7fcb825ec6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb580b5700 0x7fcb580d5bb0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb74004750 tx=0x7fcb74009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:32.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:31 trial134 ceph-mon[27948]: pgmap v225: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:26:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.377+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcb7c0f5c60 con 0x7fcb7c0f5140 2026-02-13T01:26:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.377+0000 7fcb677fe6c0 1 -- 10.20.193.28:0/2852408045 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcb700a72e0 con 0x7fcb7c0f5140 2026-02-13T01:26:32.379 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:32.379 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb580b5700 msgr2=0x7fcb580d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb580b5700 0x7fcb580d5bb0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb74004750 tx=0x7fcb74009260 comp rx=0 tx=0).stop 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c0f5140 msgr2=0x7fcb7c0fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c0f5140 0x7fcb7c0fa410 secure :-1 s=READY pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb70006f60 tx=0x7fcb7000cc00 comp rx=0 tx=0).stop 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 shutdown_connections 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fcb580b5700 0x7fcb580d5bb0 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fcb7c115410 0x7fcb7c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb7c0f5140 0x7fcb7c0fa410 unknown :-1 s=CLOSED pgs=236 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 --2- 10.20.193.28:0/2852408045 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fcb7c10f200 0x7fcb7c0f4b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 >> 10.20.193.28:0/2852408045 conn(0x7fcb7c0ecb00 msgr2=0x7fcb7c113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 shutdown_connections 2026-02-13T01:26:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:32.378+0000 7fcb657fa6c0 1 -- 10.20.193.28:0/2852408045 wait complete. 2026-02-13T01:26:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:32 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2852408045' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:32 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2852408045' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:33.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:32 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2852408045' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:34.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:33 trial187 ceph-mon[27464]: pgmap v226: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:26:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:33 trial028 ceph-mon[22984]: pgmap v226: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:26:34.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:33 trial134 ceph-mon[27948]: pgmap v226: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:26:35.124 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:34 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:35.130 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:34 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:34 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:35.517 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:35.706 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:35.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:35 trial028 ceph-mon[22984]: pgmap v227: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:35.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:35.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:35.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:35.825 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:35 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 -- 10.20.193.28:0/3727928758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e010f060 msgr2=0x7f25e010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 --2- 10.20.193.28:0/3727928758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e010f060 0x7f25e010f430 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=5546552548075698462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25d40099a0 tx=0x7f25d402ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 -- 10.20.193.28:0/3727928758 shutdown_connections 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 --2- 10.20.193.28:0/3727928758 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f25e0115270 0x7f25e0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 --2- 10.20.193.28:0/3727928758 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010fa50 0x7f25e0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 --2- 10.20.193.28:0/3727928758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e010f060 0x7f25e010f430 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=5546552548075698462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 -- 10.20.193.28:0/3727928758 >> 10.20.193.28:0/3727928758 conn(0x7f25e00ec980 msgr2=0x7f25e010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 -- 10.20.193.28:0/3727928758 shutdown_connections 2026-02-13T01:26:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.911+0000 7f25e49346c0 1 -- 10.20.193.28:0/3727928758 wait complete. 2026-02-13T01:26:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 Processor -- start 2026-02-13T01:26:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 -- start start 2026-02-13T01:26:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 0x7f25e0066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e0115270 0x7f25e0062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f25e0062f70 0x7f25e0063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01679e0 con 0x7f25e0115270 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0167b50 con 0x7f25e010f060 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.912+0000 7f25e49346c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0167d10 con 0x7f25e0062f70 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 0x7f25e0066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 0x7f25e0066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:50572/0 (socket says 10.20.193.28:50572) 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 -- 10.20.193.28:0/518523214 learned_addr learned my addr 10.20.193.28:0/518523214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25df5776c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f25e0062f70 0x7f25e0063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25de5756c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e0115270 0x7f25e0062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 -- 10.20.193.28:0/518523214 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f25e0062f70 msgr2=0x7f25e0063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f25e0062f70 0x7f25e0063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 -- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e0115270 msgr2=0x7f25e0062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e0115270 0x7f25e0062990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 -- 10.20.193.28:0/518523214 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d4009590 con 0x7f25e010f060 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25de5756c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e0115270 0x7f25e0062990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.913+0000 7f25ded766c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 0x7f25e0066730 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25d40098c0 tx=0x7f25d402fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.914+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25d4002ae0 con 0x7f25e010f060 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.914+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f25d4002c40 con 0x7f25e010f060 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.914+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e0167f90 con 0x7f25e010f060 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.914+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25d40372f0 con 0x7f25e010f060 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.914+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e0168460 con 0x7f25e010f060 2026-02-13T01:26:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.914+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0110330 con 0x7f25e010f060 2026-02-13T01:26:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.917+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f25d40077d0 con 0x7f25e010f060 2026-02-13T01:26:35.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.918+0000 7f25bffff6c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f25b40b5710 0x7f25b40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:35.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.918+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f25d4107c10 con 0x7f25e010f060 2026-02-13T01:26:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.918+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f25d4108090 con 0x7f25e010f060 2026-02-13T01:26:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.918+0000 7f25de5756c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f25b40b5710 0x7f25b40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:35.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:35.919+0000 7f25de5756c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f25b40b5710 0x7f25b40d5bc0 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25e010d780 tx=0x7f25c8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:36.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.047+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f25e0063c90 con 0x7f25e010f060 2026-02-13T01:26:36.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.047+0000 7f25bffff6c0 1 -- 10.20.193.28:0/518523214 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f25d40ca510 con 0x7f25e010f060 2026-02-13T01:26:36.048 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:36.048 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:36.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f25b40b5710 msgr2=0x7f25b40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f25b40b5710 0x7f25b40d5bc0 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25e010d780 tx=0x7f25c8009260 comp rx=0 tx=0).stop 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 msgr2=0x7f25e0066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 0x7f25e0066730 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25d40098c0 tx=0x7f25d402fc70 comp rx=0 tx=0).stop 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 shutdown_connections 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f25b40b5710 0x7f25b40d5bc0 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f25e0062f70 0x7f25e0063410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25e0115270 0x7f25e0062990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 --2- 10.20.193.28:0/518523214 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f25e010f060 0x7f25e0066730 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 >> 10.20.193.28:0/518523214 conn(0x7f25e00ec980 msgr2=0x7f25e010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:36.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.048+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 shutdown_connections 2026-02-13T01:26:36.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:36.049+0000 7f25e49346c0 1 -- 10.20.193.28:0/518523214 wait complete. 2026-02-13T01:26:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:35 trial187 ceph-mon[27464]: pgmap v227: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:35 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:35 trial134 ceph-mon[27948]: pgmap v227: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:36.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:35 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:37.141 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:36 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/518523214' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:37.141 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:36 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:37.141 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:36 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:36 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/518523214' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:36 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:36 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:37.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:36 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/518523214' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:37.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:36 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:37.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:36 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: pgmap v228: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: pgmap v229: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:26:38.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:37 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: pgmap v228: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: pgmap v229: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:38.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:38.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:26:38.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:37 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: pgmap v228: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: pgmap v229: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:38.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:26:38.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:37 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:26:39.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:38 trial187 ceph-mon[27464]: pgmap v230: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:26:39.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:38 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:26:39.157 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:38 trial028 ceph-mon[22984]: pgmap v230: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:26:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:38 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:26:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:38 trial134 ceph-mon[27948]: pgmap v230: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:26:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:38 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:26:39.340 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:39.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.533+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/1944442935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b881148b0 msgr2=0x7f7b88114c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.533+0000 7f7b8e1d86c0 1 --2- 10.20.193.28:0/1944442935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b881148b0 0x7f7b88114c80 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=9911953928746063030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b7400aaf0 tx=0x7f7b7402fe90 comp rx=0 tx=0).stop 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/1944442935 shutdown_connections 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 --2- 10.20.193.28:0/1944442935 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88116f80 0x7f7b8817ab60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 --2- 10.20.193.28:0/1944442935 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881152a0 0x7f7b881167a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 --2- 10.20.193.28:0/1944442935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b881148b0 0x7f7b88114c80 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=9911953928746063030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/1944442935 >> 10.20.193.28:0/1944442935 conn(0x7f7b88058a50 msgr2=0x7f7b88058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/1944442935 shutdown_connections 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/1944442935 wait complete. 2026-02-13T01:26:39.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 Processor -- start 2026-02-13T01:26:39.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.534+0000 7f7b8e1d86c0 1 -- start start 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b8e1d86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 0x7f7b88124170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b8e1d86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b88116f80 0x7f7b881246b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b8e1d86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88129a70 0x7f7b88129f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b8e1d86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8812a480 con 0x7f7b88116f80 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b8e1d86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8812a5f0 con 0x7f7b881148b0 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b8e1d86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8812a7b0 con 0x7f7b88129a70 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 0x7f7b88124170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 0x7f7b88124170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:53128/0 (socket says 10.20.193.28:53128) 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 -- 10.20.193.28:0/121228068 learned_addr learned my addr 10.20.193.28:0/121228068 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b86ffd6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b88116f80 0x7f7b881246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b87fff6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88129a70 0x7f7b88129f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 -- 10.20.193.28:0/121228068 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88129a70 msgr2=0x7f7b88129f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88129a70 0x7f7b88129f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 -- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b88116f80 msgr2=0x7f7b881246b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b88116f80 0x7f7b881246b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b877fe6c0 1 -- 10.20.193.28:0/121228068 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7400a6e0 con 0x7f7b881148b0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.535+0000 7f7b87fff6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88129a70 0x7f7b88129f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b877fe6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 0x7f7b88124170 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b740303a0 tx=0x7f7b74005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b740028d0 con 0x7f7b881148b0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/121228068 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8816ac00 con 0x7f7b881148b0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7b7400a130 con 0x7f7b881148b0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b740077b0 con 0x7f7b881148b0 2026-02-13T01:26:39.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b8e1d86c0 1 -- 10.20.193.28:0/121228068 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b88121c10 con 0x7f7b881148b0 2026-02-13T01:26:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.536+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b8805b000 con 0x7f7b881148b0 2026-02-13T01:26:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.538+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f7b74002a30 con 0x7f7b881148b0 2026-02-13T01:26:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.540+0000 7f7b84ff96c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7b5c0b9ba0 0x7f7b5c0da050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.540+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f7b74107d50 con 0x7f7b881148b0 2026-02-13T01:26:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.540+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b741081d0 con 0x7f7b881148b0 2026-02-13T01:26:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.540+0000 7f7b86ffd6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7b5c0b9ba0 0x7f7b5c0da050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.541+0000 7f7b86ffd6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7b5c0b9ba0 0x7f7b5c0da050 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b8812ab00 tx=0x7f7b78009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:39.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.666+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b88114c80 con 0x7f7b881148b0 2026-02-13T01:26:39.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.666+0000 7f7b84ff96c0 1 -- 10.20.193.28:0/121228068 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7b740ca650 con 0x7f7b881148b0 2026-02-13T01:26:39.667 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:39.667 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7b5c0b9ba0 msgr2=0x7f7b5c0da050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7b5c0b9ba0 0x7f7b5c0da050 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b8812ab00 tx=0x7f7b78009260 comp rx=0 tx=0).stop 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 msgr2=0x7f7b88124170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 0x7f7b88124170 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b740303a0 tx=0x7f7b74005e50 comp rx=0 tx=0).stop 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 shutdown_connections 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7b5c0b9ba0 0x7f7b5c0da050 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7b88129a70 0x7f7b88129f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b88116f80 0x7f7b881246b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 --2- 10.20.193.28:0/121228068 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7b881148b0 0x7f7b88124170 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 >> 10.20.193.28:0/121228068 conn(0x7f7b88058a50 msgr2=0x7f7b881177f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 shutdown_connections 2026-02-13T01:26:39.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:39.667+0000 7f7b627fc6c0 1 -- 10.20.193.28:0/121228068 wait complete. 2026-02-13T01:26:40.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:39 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/121228068' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:39 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/121228068' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:40.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:39 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/121228068' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:40 trial187 ceph-mon[27464]: pgmap v231: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:40 trial028 ceph-mon[22984]: pgmap v231: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:41.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:40 trial134 ceph-mon[27948]: pgmap v231: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:42.770 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:42.955 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:43.087 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:42 trial028 ceph-mon[22984]: pgmap v232: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:42 trial187 ceph-mon[27464]: pgmap v232: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:43.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/852233921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 msgr2=0x7f2cf4175ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/852233921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4175ab0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=14894799971034833082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf0006fd0 tx=0x7f2cf002fd30 comp rx=0 tx=0).stop 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/852233921 shutdown_connections 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/852233921 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4061030 0x7f2cf4155190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/852233921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4175ab0 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=14894799971034833082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/852233921 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4060720 0x7f2cf4060af0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/852233921 >> 10.20.193.28:0/852233921 conn(0x7f2cf40ea8e0 msgr2=0x7f2cf410acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/852233921 shutdown_connections 2026-02-13T01:26:43.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.146+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/852233921 wait complete. 2026-02-13T01:26:43.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.147+0000 7f2cfc4d86c0 1 Processor -- start 2026-02-13T01:26:43.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.147+0000 7f2cfc4d86c0 1 -- start start 2026-02-13T01:26:43.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfc4d86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4060720 0x7f2cf41613f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfc4d86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 0x7f2cf4161930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfc4d86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4166cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfc4d86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4167340 con 0x7f2cf41556d0 2026-02-13T01:26:43.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfc4d86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf41674b0 con 0x7f2cf4061030 2026-02-13T01:26:43.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfc4d86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4167670 con 0x7f2cf4060720 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 0x7f2cf4161930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfa2496c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4060720 0x7f2cf41613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 0x7f2cf4161930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:53136/0 (socket says 10.20.193.28:53136) 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 -- 10.20.193.28:0/4094581891 learned_addr learned my addr 10.20.193.28:0/4094581891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfa2496c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4060720 0x7f2cf41613f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:60528/0 (socket says 10.20.193.28:60528) 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfaa4a6c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 -- 10.20.193.28:0/4094581891 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4060720 msgr2=0x7f2cf41613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4060720 0x7f2cf41613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 -- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 msgr2=0x7f2cf4166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4166cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cf9a486c0 1 -- 10.20.193.28:0/4094581891 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf000a5b0 con 0x7f2cf4061030 2026-02-13T01:26:43.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.148+0000 7f2cfaa4a6c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4166cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:26:43.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.149+0000 7f2cf9a486c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 0x7f2cf4161930 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce8005980 tx=0x7f2ce800bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:43.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.149+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ce8004a80 con 0x7f2cf4061030 2026-02-13T01:26:43.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.149+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2ce8009030 con 0x7f2cf4061030 2026-02-13T01:26:43.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.149+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ce8005710 con 0x7f2cf4061030 2026-02-13T01:26:43.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.149+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf4167950 con 0x7f2cf4061030 2026-02-13T01:26:43.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.149+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf410cdd0 con 0x7f2cf4061030 2026-02-13T01:26:43.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.150+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf4167b70 con 0x7f2cf4061030 2026-02-13T01:26:43.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.151+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f2ce800c7a0 con 0x7f2cf4061030 2026-02-13T01:26:43.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.153+0000 7f2cdb7fe6c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2cd00b5700 0x7f2cd00d5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.153+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f2ce80e3b30 con 0x7f2cf4061030 2026-02-13T01:26:43.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.153+0000 7f2cfa2496c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2cd00b5700 0x7f2cd00d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:43.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.153+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ce811c5e0 con 0x7f2cf4061030 2026-02-13T01:26:43.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.154+0000 7f2cfa2496c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2cd00b5700 0x7f2cd00d5bb0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce4004750 tx=0x7f2ce4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.276+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2cf4061c30 con 0x7f2cf4061030 2026-02-13T01:26:43.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.277+0000 7f2cdb7fe6c0 1 -- 10.20.193.28:0/4094581891 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2ce80a6430 con 0x7f2cf4061030 2026-02-13T01:26:43.277 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:43.277 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2cd00b5700 msgr2=0x7f2cd00d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2cd00b5700 0x7f2cd00d5bb0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce4004750 tx=0x7f2ce4009390 comp rx=0 tx=0).stop 2026-02-13T01:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 msgr2=0x7f2cf4161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 0x7f2cf4161930 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce8005980 tx=0x7f2ce800bc30 comp rx=0 tx=0).stop 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 shutdown_connections 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2cf41556d0 0x7f2cf4166cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2cf4061030 0x7f2cf4161930 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2cd00b5700 0x7f2cd00d5bb0 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 --2- 10.20.193.28:0/4094581891 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2cf4060720 0x7f2cf41613f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 >> 10.20.193.28:0/4094581891 conn(0x7f2cf40ea8e0 msgr2=0x7f2cf410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:43.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 shutdown_connections 2026-02-13T01:26:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:43.278+0000 7f2cfc4d86c0 1 -- 10.20.193.28:0/4094581891 wait complete. 2026-02-13T01:26:43.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:42 trial134 ceph-mon[27948]: pgmap v232: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:43 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4094581891' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:43 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4094581891' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:44.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:43 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4094581891' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:44 trial187 ceph-mon[27464]: pgmap v233: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:45.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:44 trial028 ceph-mon[22984]: pgmap v233: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:45.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:44 trial134 ceph-mon[27948]: pgmap v233: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:26:46.417 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:46.602 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.794+0000 7f1f107796c0 1 -- 10.20.193.28:0/3189812066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f0810f200 msgr2=0x7f1f0810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.794+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3189812066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f0810f200 0x7f1f0810f5d0 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=12518781151394946543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ef80099a0 tx=0x7f1ef802ed00 comp rx=0 tx=0).stop 2026-02-13T01:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 -- 10.20.193.28:0/3189812066 shutdown_connections 2026-02-13T01:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3189812066 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810fbf0 0x7f1f08114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3189812066 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1f08115410 0x7f1f08175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3189812066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f0810f200 0x7f1f0810f5d0 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=12518781151394946543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 -- 10.20.193.28:0/3189812066 >> 10.20.193.28:0/3189812066 conn(0x7f1f080ecb00 msgr2=0x7f1f0810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 -- 10.20.193.28:0/3189812066 shutdown_connections 2026-02-13T01:26:46.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 -- 10.20.193.28:0/3189812066 wait complete. 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 Processor -- start 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.795+0000 7f1f107796c0 1 -- start start 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f107796c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 0x7f1f0811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f107796c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1f08115410 0x7f1f0811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f107796c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f08122ae0 0x7f1f08122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f107796c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081234f0 con 0x7f1f08122ae0 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f107796c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08123660 con 0x7f1f08115410 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f107796c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08123820 con 0x7f1f0810f200 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 0x7f1f0811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 0x7f1f0811d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:41276/0 (socket says 10.20.193.28:41276) 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 -- 10.20.193.28:0/3727253906 learned_addr learned my addr 10.20.193.28:0/3727253906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0dce96c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1f08115410 0x7f1f0811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0eceb6c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f08122ae0 0x7f1f08122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 -- 10.20.193.28:0/3727253906 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1f08115410 msgr2=0x7f1f0811d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1f08115410 0x7f1f0811d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 -- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f08122ae0 msgr2=0x7f1f08122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f08122ae0 0x7f1f08122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 -- 10.20.193.28:0/3727253906 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef8009590 con 0x7f1f0810f200 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.796+0000 7f1f0e4ea6c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 0x7f1f0811d1e0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ef80098c0 tx=0x7f1ef802fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.797+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ef8002ae0 con 0x7f1f0810f200 2026-02-13T01:26:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.797+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f08163c70 con 0x7f1f0810f200 2026-02-13T01:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.797+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ef8007740 con 0x7f1f0810f200 2026-02-13T01:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.797+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ef8037630 con 0x7f1f0810f200 2026-02-13T01:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.797+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f081640f0 con 0x7f1f0810f200 2026-02-13T01:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.797+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f081104d0 con 0x7f1f0810f200 2026-02-13T01:26:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.799+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f1ef8002c40 con 0x7f1f0810f200 2026-02-13T01:26:46.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.801+0000 7f1eef7fe6c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1ee40b5690 0x7f1ee40d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.801+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7f1ef8107ca0 con 0x7f1f0810f200 2026-02-13T01:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.802+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1ef8108120 con 0x7f1f0810f200 2026-02-13T01:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.802+0000 7f1f0dce96c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1ee40b5690 0x7f1ee40d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.802+0000 7f1f0dce96c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1ee40b5690 0x7f1ee40d5b40 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f08123b70 tx=0x7f1efc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:46.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.926+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f0810f5d0 con 0x7f1f0810f200 2026-02-13T01:26:46.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.926+0000 7f1eef7fe6c0 1 -- 10.20.193.28:0/3727253906 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1ef80ca5a0 con 0x7f1f0810f200 2026-02-13T01:26:46.926 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:46.927 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:46.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1ee40b5690 msgr2=0x7f1ee40d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1ee40b5690 0x7f1ee40d5b40 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f08123b70 tx=0x7f1efc009260 comp rx=0 tx=0).stop 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 msgr2=0x7f1f0811d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 0x7f1f0811d1e0 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ef80098c0 tx=0x7f1ef802fc60 comp rx=0 tx=0).stop 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 shutdown_connections 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f08122ae0 0x7f1f08122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1f08115410 0x7f1f0811d720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1ee40b5690 0x7f1ee40d5b40 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 --2- 10.20.193.28:0/3727253906 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1f0810f200 0x7f1f0811d1e0 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 >> 10.20.193.28:0/3727253906 conn(0x7f1f080ecb00 msgr2=0x7f1f0810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 shutdown_connections 2026-02-13T01:26:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:46.927+0000 7f1f107796c0 1 -- 10.20.193.28:0/3727253906 wait complete. 2026-02-13T01:26:46.987 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:46 trial028 ceph-mon[22984]: pgmap v234: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:46 trial187 ceph-mon[27464]: pgmap v234: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:47.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:46 trial134 ceph-mon[27948]: pgmap v234: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:26:48.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:47 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3727253906' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:47 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3727253906' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:48.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:47 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3727253906' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:49.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:48 trial187 ceph-mon[27464]: pgmap v235: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:48 trial028 ceph-mon[22984]: pgmap v235: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:49.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:48 trial134 ceph-mon[27948]: pgmap v235: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:26:50.029 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:50.214 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:50.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 -- 10.20.193.28:0/1945045219 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10c680 msgr2=0x7fdacc1116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/1945045219 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10c680 0x7fdacc1116c0 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=10436877888472201770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab4009970 tx=0x7fdab402ed10 comp rx=0 tx=0).stop 2026-02-13T01:26:50.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 -- 10.20.193.28:0/1945045219 shutdown_connections 2026-02-13T01:26:50.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/1945045219 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdacc111ea0 0x7fdacc172840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/1945045219 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10c680 0x7fdacc1116c0 unknown :-1 s=CLOSED pgs=111 gs=3 cs=0 l=1 c_cookie=10436877888472201770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/1945045219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc10bc90 0x7fdacc10c060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 -- 10.20.193.28:0/1945045219 >> 10.20.193.28:0/1945045219 conn(0x7fdacc0e9590 msgr2=0x7fdacc1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:50.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 -- 10.20.193.28:0/1945045219 shutdown_connections 2026-02-13T01:26:50.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 -- 10.20.193.28:0/1945045219 wait complete. 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.418+0000 7fdad1c476c0 1 Processor -- start 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 -- start start 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10bc90 0x7fdacc0f1610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 0x7fdacc172740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdacc0f1c40 0x7fdacc0f6f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0f2330 con 0x7fdacc111ea0 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0f7450 con 0x7fdacc10bc90 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad1c476c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0f7610 con 0x7fdacc0f1c40 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 0x7fdacc172740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad0c456c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10bc90 0x7fdacc0f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 0x7fdacc172740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34708/0 (socket says 10.20.193.28:34708) 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 -- 10.20.193.28:0/3930648303 learned_addr learned my addr 10.20.193.28:0/3930648303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdad14466c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdacc0f1c40 0x7fdacc0f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 -- 10.20.193.28:0/3930648303 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdacc0f1c40 msgr2=0x7fdacc0f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdacc0f1c40 0x7fdacc0f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 -- 10.20.193.28:0/3930648303 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10bc90 msgr2=0x7fdacc0f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10bc90 0x7fdacc0f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 -- 10.20.193.28:0/3930648303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc0094c0 con 0x7fdacc111ea0 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac3fff6c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 0x7fdacc172740 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab4031fd0 tx=0x7fdab402fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.419+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab4002ae0 con 0x7fdacc111ea0 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.420+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdab40046b0 con 0x7fdacc111ea0 2026-02-13T01:26:50.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.420+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab4009590 con 0x7fdacc111ea0 2026-02-13T01:26:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.420+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdab40372f0 con 0x7fdacc111ea0 2026-02-13T01:26:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.420+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdacc0f7b80 con 0x7fdacc111ea0 2026-02-13T01:26:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.420+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdacc10cf60 con 0x7fdacc111ea0 2026-02-13T01:26:50.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.422+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fdab40077d0 con 0x7fdacc111ea0 2026-02-13T01:26:50.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.424+0000 7fdac1ffb6c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdaa80b5690 0x7fdaa80d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.424+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8052+0+0 (secure 0 0 0) 0x7fdab4107e60 con 0x7fdacc111ea0 2026-02-13T01:26:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.424+0000 7fdad0c456c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdaa80b5690 0x7fdaa80d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.424+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdab41082e0 con 0x7fdacc111ea0 2026-02-13T01:26:50.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.425+0000 7fdad0c456c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdaa80b5690 0x7fdaa80d5b40 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdabc004750 tx=0x7fdabc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:50.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.549+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdacc0f77d0 con 0x7fdacc111ea0 2026-02-13T01:26:50.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.549+0000 7fdac1ffb6c0 1 -- 10.20.193.28:0/3930648303 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdab40ca760 con 0x7fdacc111ea0 2026-02-13T01:26:50.550 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:50.550 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:50.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdaa80b5690 msgr2=0x7fdaa80d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdaa80b5690 0x7fdaa80d5b40 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdabc004750 tx=0x7fdabc009260 comp rx=0 tx=0).stop 2026-02-13T01:26:50.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 msgr2=0x7fdacc172740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 0x7fdacc172740 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdab4031fd0 tx=0x7fdab402fca0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 shutdown_connections 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdaa80b5690 0x7fdaa80d5b40 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdacc0f1c40 0x7fdacc0f6f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdacc111ea0 0x7fdacc172740 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 --2- 10.20.193.28:0/3930648303 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdacc10bc90 0x7fdacc0f1610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.550+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 >> 10.20.193.28:0/3930648303 conn(0x7fdacc0e9590 msgr2=0x7fdacc10a250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.551+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 shutdown_connections 2026-02-13T01:26:50.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:50.551+0000 7fdad1c476c0 1 -- 10.20.193.28:0/3930648303 wait complete. 2026-02-13T01:26:50.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:50 trial028 ceph-mon[22984]: pgmap v236: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:50.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2026-02-13T01:26:50.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:50 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]} : dispatch 2026-02-13T01:26:50.947 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:50 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3930648303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:50 trial187 ceph-mon[27464]: pgmap v236: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2026-02-13T01:26:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:50 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]} : dispatch 2026-02-13T01:26:51.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:50 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3930648303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:51.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:50 trial134 ceph-mon[27948]: pgmap v236: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:26:51.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2026-02-13T01:26:51.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:50 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]} : dispatch 2026-02-13T01:26:51.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:50 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3930648303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:52.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2026-02-13T01:26:52.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:51 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2026-02-13T01:26:52.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:51 trial187 ceph-mon[27464]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T01:26:52.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2026-02-13T01:26:52.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:51 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2026-02-13T01:26:52.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:51 trial028 ceph-mon[22984]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T01:26:52.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2026-02-13T01:26:52.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:51 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2026-02-13T01:26:52.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:51 trial134 ceph-mon[27948]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T01:26:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:52 trial187 ceph-mon[27464]: pgmap v238: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:26:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:52 trial187 ceph-mon[27464]: osdmap e79: 12 total, 12 up, 12 in 2026-02-13T01:26:53.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:52 trial028 ceph-mon[22984]: pgmap v238: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:26:53.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:52 trial028 ceph-mon[22984]: osdmap e79: 12 total, 12 up, 12 in 2026-02-13T01:26:53.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:52 trial134 ceph-mon[27948]: pgmap v238: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:26:53.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:52 trial134 ceph-mon[27948]: osdmap e79: 12 total, 12 up, 12 in 2026-02-13T01:26:53.657 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:53.844 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:53.975 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:53 trial028 ceph-mon[22984]: mgrmap e12: x(active, since 4m), standbys: z, y 2026-02-13T01:26:54.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.040+0000 7fdb71d186c0 1 -- 10.20.193.28:0/930847273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c115270 msgr2=0x7fdb6c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:54.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.040+0000 7fdb71d186c0 1 --2- 10.20.193.28:0/930847273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c115270 0x7fdb6c175c10 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=6586855236038888802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb6800aa70 tx=0x7fdb6802fdd0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.041+0000 7fdb71d186c0 1 -- 10.20.193.28:0/930847273 shutdown_connections 2026-02-13T01:26:54.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.041+0000 7fdb71d186c0 1 --2- 10.20.193.28:0/930847273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c115270 0x7fdb6c175c10 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=6586855236038888802 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.041+0000 7fdb71d186c0 1 --2- 10.20.193.28:0/930847273 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdb6c10fa50 0x7fdb6c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.041+0000 7fdb71d186c0 1 --2- 10.20.193.28:0/930847273 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdb6c10f060 0x7fdb6c10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.041+0000 7fdb71d186c0 1 -- 10.20.193.28:0/930847273 >> 10.20.193.28:0/930847273 conn(0x7fdb6c0ec980 msgr2=0x7fdb6c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.042+0000 7fdb71d186c0 1 -- 10.20.193.28:0/930847273 shutdown_connections 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.042+0000 7fdb71d186c0 1 -- 10.20.193.28:0/930847273 wait complete. 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.042+0000 7fdb71d186c0 1 Processor -- start 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.042+0000 7fdb71d186c0 1 -- start start 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 0x7fdb6c11cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdb6c115270 0x7fdb6c11d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdb6c122860 0x7fdb6c122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c123270 con 0x7fdb6c10f060 2026-02-13T01:26:54.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1233e0 con 0x7fdb6c115270 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c1235a0 con 0x7fdb6c122860 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 0x7fdb6c11cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 0x7fdb6c11cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34728/0 (socket says 10.20.193.28:34728) 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 -- 10.20.193.28:0/2257131047 learned_addr learned my addr 10.20.193.28:0/2257131047 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb63fff6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdb6c115270 0x7fdb6c11d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb715176c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdb6c122860 0x7fdb6c122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 -- 10.20.193.28:0/2257131047 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdb6c122860 msgr2=0x7fdb6c122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdb6c122860 0x7fdb6c122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 -- 10.20.193.28:0/2257131047 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdb6c115270 msgr2=0x7fdb6c11d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdb6c115270 0x7fdb6c11d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 -- 10.20.193.28:0/2257131047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6800a660 con 0x7fdb6c10f060 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb70d166c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 0x7fdb6c11cf60 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5c00b710 tx=0x7fdb5c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5c004250 con 0x7fdb6c10f060 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb5c009070 con 0x7fdb6c10f060 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5c00cd70 con 0x7fdb6c10f060 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.043+0000 7fdb71d186c0 1 -- 10.20.193.28:0/2257131047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c163a50 con 0x7fdb6c10f060 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.044+0000 7fdb71d186c0 1 -- 10.20.193.28:0/2257131047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c163ee0 con 0x7fdb6c10f060 2026-02-13T01:26:54.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.044+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c110330 con 0x7fdb6c10f060 2026-02-13T01:26:54.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.046+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fdb5c0028c0 con 0x7fdb6c10f060 2026-02-13T01:26:54.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.048+0000 7fdb61ffb6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdb480b5680 0x7fdb480d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:54.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.048+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fdb5c0e3af0 con 0x7fdb6c10f060 2026-02-13T01:26:54.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.048+0000 7fdb63fff6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdb480b5680 0x7fdb480d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:54.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.048+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb5c11c5e0 con 0x7fdb6c10f060 2026-02-13T01:26:54.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.049+0000 7fdb63fff6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdb480b5680 0x7fdb480d5b30 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb6c1238f0 tx=0x7fdb54009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:54.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:53 trial187 ceph-mon[27464]: mgrmap e12: x(active, since 4m), standbys: z, y 2026-02-13T01:26:54.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.173+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdb6c11e0b0 con 0x7fdb6c10f060 2026-02-13T01:26:54.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.173+0000 7fdb61ffb6c0 1 -- 10.20.193.28:0/2257131047 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdb5c0a6520 con 0x7fdb6c10f060 2026-02-13T01:26:54.174 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:54.174 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdb480b5680 msgr2=0x7fdb480d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdb480b5680 0x7fdb480d5b30 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb6c1238f0 tx=0x7fdb54009390 comp rx=0 tx=0).stop 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 msgr2=0x7fdb6c11cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 0x7fdb6c11cf60 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5c00b710 tx=0x7fdb5c00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 shutdown_connections 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fdb480b5680 0x7fdb480d5b30 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fdb6c122860 0x7fdb6c122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fdb6c115270 0x7fdb6c11d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 --2- 10.20.193.28:0/2257131047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb6c10f060 0x7fdb6c11cf60 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:54.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 >> 10.20.193.28:0/2257131047 conn(0x7fdb6c0ec980 msgr2=0x7fdb6c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:54.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.174+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 shutdown_connections 2026-02-13T01:26:54.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:54.175+0000 7fdb3b7fe6c0 1 -- 10.20.193.28:0/2257131047 wait complete. 2026-02-13T01:26:54.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:53 trial134 ceph-mon[27948]: mgrmap e12: x(active, since 4m), standbys: z, y 2026-02-13T01:26:55.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:54 trial187 ceph-mon[27464]: pgmap v240: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-13T01:26:55.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:54 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2257131047' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:55.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:54 trial028 ceph-mon[22984]: pgmap v240: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-13T01:26:55.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:54 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2257131047' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:55.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:54 trial134 ceph-mon[27948]: pgmap v240: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-13T01:26:55.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:54 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2257131047' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:56 trial187 ceph-mon[27464]: pgmap v241: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s 2026-02-13T01:26:57.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:56 trial028 ceph-mon[22984]: pgmap v241: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s 2026-02-13T01:26:57.279 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:57.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:56 trial134 ceph-mon[27948]: pgmap v241: 97 pgs: 1 peering, 96 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 639 B/s wr, 7 op/s 2026-02-13T01:26:57.464 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:26:57.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 -- 10.20.193.28:0/3533721546 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810fbf0 msgr2=0x7f00a8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:57.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 --2- 10.20.193.28:0/3533721546 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810fbf0 0x7f00a8114c30 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=17044996716212788595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00900098a0 tx=0x7f009002ec50 comp rx=0 tx=0).stop 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 -- 10.20.193.28:0/3533721546 shutdown_connections 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 --2- 10.20.193.28:0/3533721546 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 0x7f00a8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 --2- 10.20.193.28:0/3533721546 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810fbf0 0x7f00a8114c30 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=17044996716212788595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 --2- 10.20.193.28:0/3533721546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a810f200 0x7f00a810f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 -- 10.20.193.28:0/3533721546 >> 10.20.193.28:0/3533721546 conn(0x7f00a80ecb00 msgr2=0x7f00a810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 -- 10.20.193.28:0/3533721546 shutdown_connections 2026-02-13T01:26:57.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.661+0000 7f00aca086c0 1 -- 10.20.193.28:0/3533721546 wait complete. 2026-02-13T01:26:57.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 Processor -- start 2026-02-13T01:26:57.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 -- start start 2026-02-13T01:26:57.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810f200 0x7f00a80f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:57.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 0x7f00a8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:57.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a80f5120 0x7f00a80fa3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:57.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80f5810 con 0x7f00a80f5120 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80fa8e0 con 0x7f00a810f200 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00aca086c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f00a80faaa0 con 0x7f00a8115410 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a5d746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 0x7f00a8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a6d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a80f5120 0x7f00a80fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a5d746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 0x7f00a8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:34982/0 (socket says 10.20.193.28:34982) 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a5d746c0 1 -- 10.20.193.28:0/98880809 learned_addr learned my addr 10.20.193.28:0/98880809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a65756c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810f200 0x7f00a80f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a6d766c0 1 -- 10.20.193.28:0/98880809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 msgr2=0x7f00a8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a6d766c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 0x7f00a8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a6d766c0 1 -- 10.20.193.28:0/98880809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810f200 msgr2=0x7f00a80f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:57.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.662+0000 7f00a6d766c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810f200 0x7f00a80f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f00a6d766c0 1 -- 10.20.193.28:0/98880809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900094c0 con 0x7f00a80f5120 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f00a6d766c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a80f5120 0x7f00a80fa3a0 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0098006f60 tx=0x7f009800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0098003c40 con 0x7f00a80f5120 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f00aca086c0 1 -- 10.20.193.28:0/98880809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a80fad80 con 0x7f00a80f5120 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0098003da0 con 0x7f00a80f5120 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f009800de80 con 0x7f00a80f5120 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f00aca086c0 1 -- 10.20.193.28:0/98880809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a80fb510 con 0x7f00a80f5120 2026-02-13T01:26:57.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.663+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a80fb260 con 0x7f00a80f5120 2026-02-13T01:26:57.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.666+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f0098005030 con 0x7f00a80f5120 2026-02-13T01:26:57.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.667+0000 7f008f7fe6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f00800b5670 0x7f00800d5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:57.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.667+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f00980e4a80 con 0x7f00a80f5120 2026-02-13T01:26:57.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.668+0000 7f00a65756c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f00800b5670 0x7f00800d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:57.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.668+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f009811d5e0 con 0x7f00a80f5120 2026-02-13T01:26:57.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.668+0000 7f00a65756c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f00800b5670 0x7f00800d5b20 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f009c004750 tx=0x7f009c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:57.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.792+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00a81104d0 con 0x7f00a80f5120 2026-02-13T01:26:57.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.793+0000 7f008f7fe6c0 1 -- 10.20.193.28:0/98880809 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00980a74b0 con 0x7f00a80f5120 2026-02-13T01:26:57.793 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:26:57.793 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:57.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f00800b5670 msgr2=0x7f00800d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f00800b5670 0x7f00800d5b20 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f009c004750 tx=0x7f009c009260 comp rx=0 tx=0).stop 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a80f5120 msgr2=0x7f00a80fa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a80f5120 0x7f00a80fa3a0 secure :-1 s=READY pgs=244 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0098006f60 tx=0x7f009800cc00 comp rx=0 tx=0).stop 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 shutdown_connections 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f00800b5670 0x7f00800d5b20 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f00a8115410 0x7f00a8175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a80f5120 0x7f00a80fa3a0 unknown :-1 s=CLOSED pgs=244 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 --2- 10.20.193.28:0/98880809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f00a810f200 0x7f00a80f4af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 >> 10.20.193.28:0/98880809 conn(0x7f00a80ecb00 msgr2=0x7f00a810d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:57.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 shutdown_connections 2026-02-13T01:26:57.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:26:57.794+0000 7f008d7fa6c0 1 -- 10.20.193.28:0/98880809 wait complete. 2026-02-13T01:26:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:57 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/98880809' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:58.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:57 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/98880809' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:58.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:57 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/98880809' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:26:58 trial187 ceph-mon[27464]: pgmap v242: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 639 B/s wr, 5 op/s 2026-02-13T01:26:59.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:26:58 trial028 ceph-mon[22984]: pgmap v242: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 639 B/s wr, 5 op/s 2026-02-13T01:26:59.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:26:58 trial134 ceph-mon[27948]: pgmap v242: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 639 B/s wr, 5 op/s 2026-02-13T01:27:00.898 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:01.084 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:01.125 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:00 trial028 ceph-mon[22984]: pgmap v243: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 592 B/s wr, 7 op/s 2026-02-13T01:27:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:00 trial187 ceph-mon[27464]: pgmap v243: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 592 B/s wr, 7 op/s 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 -- 10.20.193.28:0/1028839454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 msgr2=0x7fe928061110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1028839454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 0x7fe928061110 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=156417649419790749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe910009970 tx=0x7fe91002ed10 comp rx=0 tx=0).stop 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 -- 10.20.193.28:0/1028839454 shutdown_connections 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1028839454 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 0x7fe928061110 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=156417649419790749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1028839454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe928159910 0x7fe928179cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1028839454 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe9280622d0 0x7fe9280607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 -- 10.20.193.28:0/1028839454 >> 10.20.193.28:0/1028839454 conn(0x7fe9280ea6d0 msgr2=0x7fe92810aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:01.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 -- 10.20.193.28:0/1028839454 shutdown_connections 2026-02-13T01:27:01.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.278+0000 7fe92de436c0 1 -- 10.20.193.28:0/1028839454 wait complete. 2026-02-13T01:27:01.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 Processor -- start 2026-02-13T01:27:01.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 -- start start 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 0x7fe9280f2100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 0x7fe9280f2640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe928159910 0x7fe9280f7a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280f8050 con 0x7fe9280622d0 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280f81c0 con 0x7fe928159910 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe92de436c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe9280f8380 con 0x7fe928060ce0 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.279+0000 7fe91ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 0x7fe9280f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe92d6426c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe928159910 0x7fe9280f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe92ce416c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 0x7fe9280f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:01.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 0x7fe9280f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48922/0 (socket says 10.20.193.28:48922) 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 -- 10.20.193.28:0/1832489504 learned_addr learned my addr 10.20.193.28:0/1832489504 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 -- 10.20.193.28:0/1832489504 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 msgr2=0x7fe9280f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 0x7fe9280f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 -- 10.20.193.28:0/1832489504 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe928159910 msgr2=0x7fe9280f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe928159910 0x7fe9280f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 -- 10.20.193.28:0/1832489504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe910009590 con 0x7fe9280622d0 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe92d6426c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe928159910 0x7fe9280f7a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91ffff6c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 0x7fe9280f2640 secure :-1 s=READY pgs=245 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe910031fd0 tx=0x7fe91002fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe910002ae0 con 0x7fe9280622d0 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9280f8600 con 0x7fe9280622d0 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe910007740 con 0x7fe9280622d0 2026-02-13T01:27:01.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe910031550 con 0x7fe9280622d0 2026-02-13T01:27:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.280+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9280f8d20 con 0x7fe9280622d0 2026-02-13T01:27:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.281+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe928061cb0 con 0x7fe9280622d0 2026-02-13T01:27:01.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.283+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fe910002c40 con 0x7fe9280622d0 2026-02-13T01:27:01.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.285+0000 7fe91dffb6c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9040b5680 0x7fe9040d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:01.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.285+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fe910107b20 con 0x7fe9280622d0 2026-02-13T01:27:01.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.285+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe9101405e0 con 0x7fe9280622d0 2026-02-13T01:27:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.285+0000 7fe92ce416c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9040b5680 0x7fe9040d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.286+0000 7fe92ce416c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9040b5680 0x7fe9040d5b30 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe918004750 tx=0x7fe918009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:01.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:00 trial134 ceph-mon[27948]: pgmap v243: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 592 B/s wr, 7 op/s 2026-02-13T01:27:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.410+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe9280f3250 con 0x7fe9280622d0 2026-02-13T01:27:01.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.411+0000 7fe91dffb6c0 1 -- 10.20.193.28:0/1832489504 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe9100ca550 con 0x7fe9280622d0 2026-02-13T01:27:01.411 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:01.411 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.412+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9040b5680 msgr2=0x7fe9040d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.412+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9040b5680 0x7fe9040d5b30 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe918004750 tx=0x7fe918009260 comp rx=0 tx=0).stop 2026-02-13T01:27:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.412+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 msgr2=0x7fe9280f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:01.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.412+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 0x7fe9280f2640 secure :-1 s=READY pgs=245 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe910031fd0 tx=0x7fe91002fc70 comp rx=0 tx=0).stop 2026-02-13T01:27:01.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 shutdown_connections 2026-02-13T01:27:01.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe928159910 0x7fe9280f7a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9280622d0 0x7fe9280f2640 unknown :-1 s=CLOSED pgs=245 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9040b5680 0x7fe9040d5b30 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 --2- 10.20.193.28:0/1832489504 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe928060ce0 0x7fe9280f2100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:01.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 >> 10.20.193.28:0/1832489504 conn(0x7fe9280ea6d0 msgr2=0x7fe92810edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:01.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 shutdown_connections 2026-02-13T01:27:01.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:01.413+0000 7fe92de436c0 1 -- 10.20.193.28:0/1832489504 wait complete. 2026-02-13T01:27:02.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:01 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1832489504' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:01 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1832489504' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:02.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:01 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1832489504' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:02 trial187 ceph-mon[27464]: pgmap v244: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-13T01:27:03.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:02 trial028 ceph-mon[22984]: pgmap v244: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-13T01:27:03.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:02 trial134 ceph-mon[27948]: pgmap v244: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2026-02-13T01:27:04.520 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:04.705 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:04.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/818582371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810fa50 msgr2=0x7f38e8114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:04.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/818582371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810fa50 0x7f38e8114a90 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=6960343161128892439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38d40099a0 tx=0x7f38d402ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:04.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/818582371 shutdown_connections 2026-02-13T01:27:04.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/818582371 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e8115270 0x7f38e8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:04.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/818582371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810fa50 0x7f38e8114a90 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=6960343161128892439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:04.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/818582371 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38e810f060 0x7f38e810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:04.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/818582371 >> 10.20.193.28:0/818582371 conn(0x7f38e80ec980 msgr2=0x7f38e810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:04.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.911+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/818582371 shutdown_connections 2026-02-13T01:27:04.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.912+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/818582371 wait complete. 2026-02-13T01:27:04.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 Processor -- start 2026-02-13T01:27:04.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 -- start start 2026-02-13T01:27:04.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 0x7f38e80f4a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:04.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38e8115270 0x7f38e8175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e80f50b0 0x7f38e80fa380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80f5710 con 0x7f38e810f060 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80fa8c0 con 0x7f38e80f50b0 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ef59f6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80faa80 con 0x7f38e8115270 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 0x7f38e80f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 0x7f38e80f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48942/0 (socket says 10.20.193.28:48942) 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 -- 10.20.193.28:0/3493045379 learned_addr learned my addr 10.20.193.28:0/3493045379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38edd9c6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38e8115270 0x7f38e8175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38eed9e6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e80f50b0 0x7f38e80fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:04.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 -- 10.20.193.28:0/3493045379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38e8115270 msgr2=0x7f38e8175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38e8115270 0x7f38e8175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 -- 10.20.193.28:0/3493045379 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e80f50b0 msgr2=0x7f38e80fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e80f50b0 0x7f38e80fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38ee59d6c0 1 -- 10.20.193.28:0/3493045379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d4009590 con 0x7f38e810f060 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.913+0000 7f38eed9e6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e80f50b0 0x7f38e80fa380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38ee59d6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 0x7f38e80f4a80 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e00092e0 tx=0x7f38e000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e0004250 con 0x7f38e810f060 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38e00043b0 con 0x7f38e810f060 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e000cde0 con 0x7f38e810f060 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e80fad00 con 0x7f38e810f060 2026-02-13T01:27:04.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e80fb190 con 0x7f38e810f060 2026-02-13T01:27:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.914+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e8110330 con 0x7f38e810f060 2026-02-13T01:27:04.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.917+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f38e00026b0 con 0x7f38e810f060 2026-02-13T01:27:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.918+0000 7f38d37fe6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38c40b5680 0x7f38c40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.919+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f38e00e39b0 con 0x7f38e810f060 2026-02-13T01:27:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.919+0000 7f38edd9c6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38c40b5680 0x7f38c40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:04.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.919+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38e00e3e30 con 0x7f38e810f060 2026-02-13T01:27:04.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:04.919+0000 7f38edd9c6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38c40b5680 0x7f38c40d5b30 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38d40023e0 tx=0x7f38d4005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.046+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38e80f5bd0 con 0x7f38e810f060 2026-02-13T01:27:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.046+0000 7f38d37fe6c0 1 -- 10.20.193.28:0/3493045379 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38e00a63e0 con 0x7f38e810f060 2026-02-13T01:27:05.047 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:05.047 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.047+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38c40b5680 msgr2=0x7f38c40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.047+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38c40b5680 0x7f38c40d5b30 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38d40023e0 tx=0x7f38d4005c80 comp rx=0 tx=0).stop 2026-02-13T01:27:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.047+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 msgr2=0x7f38e80f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.047+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 0x7f38e80f4a80 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e00092e0 tx=0x7f38e000bc50 comp rx=0 tx=0).stop 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 shutdown_connections 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38c40b5680 0x7f38c40d5b30 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38e8115270 0x7f38e8175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38e80f50b0 0x7f38e80fa380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 --2- 10.20.193.28:0/3493045379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38e810f060 0x7f38e80f4a80 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 >> 10.20.193.28:0/3493045379 conn(0x7f38e80ec980 msgr2=0x7f38e810d640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 shutdown_connections 2026-02-13T01:27:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:05.048+0000 7f38ef59f6c0 1 -- 10.20.193.28:0/3493045379 wait complete. 2026-02-13T01:27:05.093 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:04 trial028 ceph-mon[22984]: pgmap v245: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 440 B/s wr, 7 op/s 2026-02-13T01:27:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:04 trial187 ceph-mon[27464]: pgmap v245: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 440 B/s wr, 7 op/s 2026-02-13T01:27:05.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:04 trial134 ceph-mon[27948]: pgmap v245: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 440 B/s wr, 7 op/s 2026-02-13T01:27:06.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:05 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3493045379' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:06.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:05 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3493045379' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:06.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:05 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3493045379' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:07.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:06 trial187 ceph-mon[27464]: pgmap v246: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2026-02-13T01:27:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:06 trial028 ceph-mon[22984]: pgmap v246: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2026-02-13T01:27:07.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:06 trial134 ceph-mon[27948]: pgmap v246: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2026-02-13T01:27:08.182 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:08.367 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 -- 10.20.193.28:0/393793477 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810fa50 msgr2=0x7ff468114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 --2- 10.20.193.28:0/393793477 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810fa50 0x7ff468114a90 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=9900175876610843752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4500099a0 tx=0x7ff45002ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 -- 10.20.193.28:0/393793477 shutdown_connections 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 --2- 10.20.193.28:0/393793477 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810fa50 0x7ff468114a90 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=9900175876610843752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 --2- 10.20.193.28:0/393793477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 0x7ff468175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 --2- 10.20.193.28:0/393793477 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff46810f060 0x7ff46810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 -- 10.20.193.28:0/393793477 >> 10.20.193.28:0/393793477 conn(0x7ff4680ec980 msgr2=0x7ff46810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 -- 10.20.193.28:0/393793477 shutdown_connections 2026-02-13T01:27:08.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.566+0000 7ff4675776c0 1 -- 10.20.193.28:0/393793477 wait complete. 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 Processor -- start 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 -- start start 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810f060 0x7ff4680f4980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 0x7ff468175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff4680f4fb0 0x7ff4680fa280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680f56a0 con 0x7ff468115270 2026-02-13T01:27:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680fa7c0 con 0x7ff4680f4fb0 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.567+0000 7ff4675776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680fa980 con 0x7ff46810f060 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff4665756c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810f060 0x7ff4680f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff4665756c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810f060 0x7ff4680f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:55480/0 (socket says 10.20.193.28:55480) 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff4665756c0 1 -- 10.20.193.28:0/2815956840 learned_addr learned my addr 10.20.193.28:0/2815956840 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 0x7ff468175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff466d766c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff4680f4fb0 0x7ff4680fa280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 -- 10.20.193.28:0/2815956840 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810f060 msgr2=0x7ff4680f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810f060 0x7ff4680f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 -- 10.20.193.28:0/2815956840 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff4680f4fb0 msgr2=0x7ff4680fa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff4680f4fb0 0x7ff4680fa280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 -- 10.20.193.28:0/2815956840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff450009590 con 0x7ff468115270 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff466d766c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff4680f4fb0 0x7ff4680fa280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff465d746c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 0x7ff468175b10 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff45002f230 tx=0x7ff45002fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff450002ae0 con 0x7ff468115270 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4680fac00 con 0x7ff468115270 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4500046b0 con 0x7ff468115270 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff450031440 con 0x7ff468115270 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.568+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4680fb080 con 0x7ff468115270 2026-02-13T01:27:08.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.569+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff468110330 con 0x7ff468115270 2026-02-13T01:27:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.571+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ff450002c40 con 0x7ff468115270 2026-02-13T01:27:08.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.573+0000 7ff44f7fe6c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff4400b5600 0x7ff4400d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.573+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7ff450107c10 con 0x7ff468115270 2026-02-13T01:27:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.573+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff450108090 con 0x7ff468115270 2026-02-13T01:27:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.573+0000 7ff4665756c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff4400b5600 0x7ff4400d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:08.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.574+0000 7ff4665756c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff4400b5600 0x7ff4400d5ab0 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff45c0095c0 tx=0x7ff45c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.697+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff46810f430 con 0x7ff468115270 2026-02-13T01:27:08.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.698+0000 7ff44f7fe6c0 1 -- 10.20.193.28:0/2815956840 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff4500ca640 con 0x7ff468115270 2026-02-13T01:27:08.698 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:08.698 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff4400b5600 msgr2=0x7ff4400d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff4400b5600 0x7ff4400d5ab0 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff45c0095c0 tx=0x7ff45c009260 comp rx=0 tx=0).stop 2026-02-13T01:27:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 msgr2=0x7ff468175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:08.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 0x7ff468175b10 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff45002f230 tx=0x7ff45002fc80 comp rx=0 tx=0).stop 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 shutdown_connections 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff4680f4fb0 0x7ff4680fa280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff468115270 0x7ff468175b10 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff4400b5600 0x7ff4400d5ab0 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 --2- 10.20.193.28:0/2815956840 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff46810f060 0x7ff4680f4980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 >> 10.20.193.28:0/2815956840 conn(0x7ff4680ec980 msgr2=0x7ff46810d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 shutdown_connections 2026-02-13T01:27:08.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:08.699+0000 7ff4675776c0 1 -- 10.20.193.28:0/2815956840 wait complete. 2026-02-13T01:27:09.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:08 trial187 ceph-mon[27464]: pgmap v247: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:09.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:08 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2815956840' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:08 trial028 ceph-mon[22984]: pgmap v247: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:08 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2815956840' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:08 trial134 ceph-mon[27948]: pgmap v247: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:08 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2815956840' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:11.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:10 trial187 ceph-mon[27464]: pgmap v248: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:10 trial028 ceph-mon[22984]: pgmap v248: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:11.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:10 trial134 ceph-mon[27948]: pgmap v248: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:11.803 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:11.988 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:12.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 -- 10.20.193.28:0/1126487200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c10fbf0 msgr2=0x7f018c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:12.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 --2- 10.20.193.28:0/1126487200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c10fbf0 0x7f018c114c30 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=14808526120325681858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f017c0099a0 tx=0x7f017c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 -- 10.20.193.28:0/1126487200 shutdown_connections 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 --2- 10.20.193.28:0/1126487200 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c115410 0x7f018c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 --2- 10.20.193.28:0/1126487200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c10fbf0 0x7f018c114c30 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=14808526120325681858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 --2- 10.20.193.28:0/1126487200 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 0x7f018c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 -- 10.20.193.28:0/1126487200 >> 10.20.193.28:0/1126487200 conn(0x7f018c0ecb00 msgr2=0x7f018c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 -- 10.20.193.28:0/1126487200 shutdown_connections 2026-02-13T01:27:12.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.176+0000 7f01928406c0 1 -- 10.20.193.28:0/1126487200 wait complete. 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 Processor -- start 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 -- start start 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 0x7f018c0f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c115410 0x7f018c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c0f5120 0x7f018c0fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0f5810 con 0x7f018c115410 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0fa930 con 0x7f018c0f5120 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.177+0000 7f01928406c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0faaf0 con 0x7f018c10f200 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018bfff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 0x7f018c0f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:12.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c115410 0x7f018c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018bfff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 0x7f018c0f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:55510/0 (socket says 10.20.193.28:55510) 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018bfff6c0 1 -- 10.20.193.28:0/3291364857 learned_addr learned my addr 10.20.193.28:0/3291364857 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f0190db66c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c0f5120 0x7f018c0fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 -- 10.20.193.28:0/3291364857 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 msgr2=0x7f018c0f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 0x7f018c0f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 -- 10.20.193.28:0/3291364857 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c0f5120 msgr2=0x7f018c0fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c0f5120 0x7f018c0fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 -- 10.20.193.28:0/3291364857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c009590 con 0x7f018c115410 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f0190db66c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c0f5120 0x7f018c0fa3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f018b7fe6c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c115410 0x7f018c175cb0 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f017c02f230 tx=0x7f017c02fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f017c002ae0 con 0x7f018c115410 2026-02-13T01:27:12.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c0fad70 con 0x7f018c115410 2026-02-13T01:27:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f017c0046b0 con 0x7f018c115410 2026-02-13T01:27:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.178+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c0fb240 con 0x7f018c115410 2026-02-13T01:27:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.179+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c1104d0 con 0x7f018c115410 2026-02-13T01:27:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.180+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f017c002ae0 con 0x7f018c115410 2026-02-13T01:27:12.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.181+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f017c002c40 con 0x7f018c115410 2026-02-13T01:27:12.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.183+0000 7f01897fa6c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01600b5660 0x7f01600d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:12.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.183+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f017c1078a0 con 0x7f018c115410 2026-02-13T01:27:12.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.183+0000 7f018bfff6c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01600b5660 0x7f01600d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:12.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.183+0000 7f018bfff6c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01600b5660 0x7f01600d5b10 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01780095c0 tx=0x7f0178009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:12.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.184+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f017c0ca2d0 con 0x7f018c115410 2026-02-13T01:27:12.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.308+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f018c10fbf0 con 0x7f018c115410 2026-02-13T01:27:12.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.309+0000 7f01897fa6c0 1 -- 10.20.193.28:0/3291364857 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f017c0cd480 con 0x7f018c115410 2026-02-13T01:27:12.309 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:12.309 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:12.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.309+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01600b5660 msgr2=0x7f01600d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:12.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.309+0000 7f01928406c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01600b5660 0x7f01600d5b10 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01780095c0 tx=0x7f0178009260 comp rx=0 tx=0).stop 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c115410 msgr2=0x7f018c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c115410 0x7f018c175cb0 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f017c02f230 tx=0x7f017c02fc80 comp rx=0 tx=0).stop 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 shutdown_connections 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f018c0f5120 0x7f018c0fa3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f018c115410 0x7f018c175cb0 unknown :-1 s=CLOSED pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01600b5660 0x7f01600d5b10 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 --2- 10.20.193.28:0/3291364857 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f018c10f200 0x7f018c0f4af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 >> 10.20.193.28:0/3291364857 conn(0x7f018c0ecb00 msgr2=0x7f018c10d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 shutdown_connections 2026-02-13T01:27:12.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:12.310+0000 7f01928406c0 1 -- 10.20.193.28:0/3291364857 wait complete. 2026-02-13T01:27:13.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:12 trial187 ceph-mon[27464]: pgmap v249: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:13.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:12 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3291364857' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:13.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:12 trial028 ceph-mon[22984]: pgmap v249: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:13.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:12 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3291364857' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:12 trial134 ceph-mon[27948]: pgmap v249: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:13.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:12 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3291364857' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:14 trial187 ceph-mon[27464]: pgmap v250: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:14 trial028 ceph-mon[22984]: pgmap v250: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:15.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:14 trial134 ceph-mon[27948]: pgmap v250: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:15.416 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:15.602 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/3000772461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc115270 msgr2=0x7f1dcc175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/3000772461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc115270 0x7f1dcc175c10 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=12412809928309580997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dc000aa70 tx=0x7f1dc002fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/3000772461 shutdown_connections 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/3000772461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc115270 0x7f1dcc175c10 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=12412809928309580997 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/3000772461 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1dcc10fa50 0x7f1dcc114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/3000772461 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1dcc10f060 0x7f1dcc10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/3000772461 >> 10.20.193.28:0/3000772461 conn(0x7f1dcc0ec980 msgr2=0x7f1dcc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/3000772461 shutdown_connections 2026-02-13T01:27:15.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.801+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/3000772461 wait complete. 2026-02-13T01:27:15.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 Processor -- start 2026-02-13T01:27:15.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 -- start start 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 0x7f1dcc11d040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1dcc115270 0x7f1dcc11d580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1dcc1228f0 0x7f1dcc122d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc123300 con 0x7f1dcc10f060 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc123470 con 0x7f1dcc1228f0 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.802+0000 7f1dd0ef36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc123630 con 0x7f1dcc115270 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 0x7f1dcc11d040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 0x7f1dcc11d040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48842/0 (socket says 10.20.193.28:48842) 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 -- 10.20.193.28:0/2015736657 learned_addr learned my addr 10.20.193.28:0/2015736657 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcaffd6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1dcc115270 0x7f1dcc11d580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:15.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcbfff6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1dcc1228f0 0x7f1dcc122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 -- 10.20.193.28:0/2015736657 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1dcc115270 msgr2=0x7f1dcc11d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1dcc115270 0x7f1dcc11d580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 -- 10.20.193.28:0/2015736657 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1dcc1228f0 msgr2=0x7f1dcc122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1dcc1228f0 0x7f1dcc122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 -- 10.20.193.28:0/2015736657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc000a660 con 0x7f1dcc10f060 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dcb7fe6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 0x7f1dcc11d040 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1db8009490 tx=0x7f1db800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1db8004a80 con 0x7f1dcc10f060 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1db8009030 con 0x7f1dcc10f060 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1db800ce50 con 0x7f1dcc10f060 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc163ae0 con 0x7f1dcc10f060 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.803+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc163f70 con 0x7f1dcc10f060 2026-02-13T01:27:15.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.804+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc110330 con 0x7f1dcc10f060 2026-02-13T01:27:15.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.806+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1db8004060 con 0x7f1dcc10f060 2026-02-13T01:27:15.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.808+0000 7f1dc8ff96c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1da00b5680 0x7f1da00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:15.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.808+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f1db80e3b80 con 0x7f1dcc10f060 2026-02-13T01:27:15.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.808+0000 7f1dcaffd6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1da00b5680 0x7f1da00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:15.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.808+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1db811c5e0 con 0x7f1dcc10f060 2026-02-13T01:27:15.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.809+0000 7f1dcaffd6c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1da00b5680 0x7f1da00d5b30 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dcc123980 tx=0x7f1dbc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:15.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.934+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1dcc10f430 con 0x7f1dcc10f060 2026-02-13T01:27:15.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.934+0000 7f1dc8ff96c0 1 -- 10.20.193.28:0/2015736657 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1db80a65b0 con 0x7f1dcc10f060 2026-02-13T01:27:15.935 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:15.936 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1da00b5680 msgr2=0x7f1da00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1da00b5680 0x7f1da00d5b30 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dcc123980 tx=0x7f1dbc009260 comp rx=0 tx=0).stop 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 msgr2=0x7f1dcc11d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 0x7f1dcc11d040 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1db8009490 tx=0x7f1db800bc50 comp rx=0 tx=0).stop 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 shutdown_connections 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1da00b5680 0x7f1da00d5b30 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1dcc115270 0x7f1dcc11d580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1dcc1228f0 0x7f1dcc122d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 --2- 10.20.193.28:0/2015736657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dcc10f060 0x7f1dcc11d040 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.935+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 >> 10.20.193.28:0/2015736657 conn(0x7f1dcc0ec980 msgr2=0x7f1dcc10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:15.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.936+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 shutdown_connections 2026-02-13T01:27:15.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:15.936+0000 7f1dd0ef36c0 1 -- 10.20.193.28:0/2015736657 wait complete. 2026-02-13T01:27:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:16 trial187 ceph-mon[27464]: pgmap v251: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:16 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2015736657' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:16 trial028 ceph-mon[22984]: pgmap v251: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:16 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2015736657' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:17.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:16 trial134 ceph-mon[27948]: pgmap v251: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:17.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:16 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2015736657' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:19.040 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:18 trial028 ceph-mon[22984]: pgmap v252: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:19.227 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:18 trial134 ceph-mon[27948]: pgmap v252: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:19.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:18 trial187 ceph-mon[27464]: pgmap v252: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:19.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/663944222 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d010c4e0 msgr2=0x7f82d010c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:19.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/663944222 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d010c4e0 0x7f82d010c980 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=306625210716704078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82cc00aa40 tx=0x7f82cc02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/663944222 shutdown_connections 2026-02-13T01:27:19.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/663944222 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d010c4e0 0x7f82d010c980 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=306625210716704078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/663944222 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d0112fc0 0x7f82d010b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/663944222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112b10 0x7f82d010b1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/663944222 >> 10.20.193.28:0/663944222 conn(0x7f82d0063af0 msgr2=0x7f82d00642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:19.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/663944222 shutdown_connections 2026-02-13T01:27:19.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.416+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/663944222 wait complete. 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 Processor -- start 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 -- start start 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d010c4e0 0x7f82d00f2b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d0112b10 0x7f82d00f3070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 0x7f82d00f83e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00f8a30 con 0x7f82d0112fc0 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00f8ba0 con 0x7f82d010c4e0 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d7ab86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00f8d60 con 0x7f82d0112b10 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 0x7f82d00f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:19.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 0x7f82d00f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35238/0 (socket says 10.20.193.28:35238) 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 -- 10.20.193.28:0/60634958 learned_addr learned my addr 10.20.193.28:0/60634958 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d50286c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d0112b10 0x7f82d00f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d58296c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d010c4e0 0x7f82d00f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 -- 10.20.193.28:0/60634958 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d0112b10 msgr2=0x7f82d00f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d0112b10 0x7f82d00f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 -- 10.20.193.28:0/60634958 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d010c4e0 msgr2=0x7f82d00f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d010c4e0 0x7f82d00f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d602a6c0 1 -- 10.20.193.28:0/60634958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc00a660 con 0x7f82d0112fc0 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.417+0000 7f82d58296c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d010c4e0 0x7f82d00f2b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.418+0000 7f82d602a6c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 0x7f82d00f83e0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82cc006ec0 tx=0x7f82cc0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.418+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82cc030d80 con 0x7f82d0112fc0 2026-02-13T01:27:19.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.418+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d00f8fe0 con 0x7f82d0112fc0 2026-02-13T01:27:19.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.418+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82cc0309c0 con 0x7f82d0112fc0 2026-02-13T01:27:19.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.418+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82cc032910 con 0x7f82d0112fc0 2026-02-13T01:27:19.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.418+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d00f9700 con 0x7f82d0112fc0 2026-02-13T01:27:19.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.419+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d0065120 con 0x7f82d0112fc0 2026-02-13T01:27:19.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.421+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f82cc003810 con 0x7f82d0112fc0 2026-02-13T01:27:19.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.422+0000 7f82beffd6c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f82ac0b5680 0x7f82ac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:19.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.422+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f82cc108e70 con 0x7f82d0112fc0 2026-02-13T01:27:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.422+0000 7f82d58296c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f82ac0b5680 0x7f82ac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.423+0000 7f82d58296c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f82ac0b5680 0x7f82ac0d5b30 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c0004750 tx=0x7f82c0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:19.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.423+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f82cc0cb8a0 con 0x7f82d0112fc0 2026-02-13T01:27:19.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.566+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82d010c980 con 0x7f82d0112fc0 2026-02-13T01:27:19.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.566+0000 7f82beffd6c0 1 -- 10.20.193.28:0/60634958 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f82cc0cea50 con 0x7f82d0112fc0 2026-02-13T01:27:19.567 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:19.567 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:19.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.567+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f82ac0b5680 msgr2=0x7f82ac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:19.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.567+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f82ac0b5680 0x7f82ac0d5b30 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82c0004750 tx=0x7f82c0009260 comp rx=0 tx=0).stop 2026-02-13T01:27:19.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.567+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 msgr2=0x7f82d00f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:19.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.567+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 0x7f82d00f83e0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82cc006ec0 tx=0x7f82cc0054b0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 shutdown_connections 2026-02-13T01:27:19.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f82ac0b5680 0x7f82ac0d5b30 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f82d0112b10 0x7f82d00f3070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82d0112fc0 0x7f82d00f83e0 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 --2- 10.20.193.28:0/60634958 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f82d010c4e0 0x7f82d00f2b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:19.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 >> 10.20.193.28:0/60634958 conn(0x7f82d0063af0 msgr2=0x7f82d00ed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:19.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 shutdown_connections 2026-02-13T01:27:19.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:19.569+0000 7f82d7ab86c0 1 -- 10.20.193.28:0/60634958 wait complete. 2026-02-13T01:27:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:19 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/60634958' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:20.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:19 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/60634958' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:20.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:19 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/60634958' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:21.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:20 trial028 ceph-mon[22984]: pgmap v253: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:20 trial134 ceph-mon[27948]: pgmap v253: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:21.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:20 trial187 ceph-mon[27464]: pgmap v253: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:22.706 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:22.893 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:23.025 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:22 trial028 ceph-mon[22984]: pgmap v254: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:23.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/652142007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1810fbf0 msgr2=0x7f3a18114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/652142007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1810fbf0 0x7f3a18114c30 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=15947953969582206187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a080099a0 tx=0x7f3a0802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:23.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/652142007 shutdown_connections 2026-02-13T01:27:23.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/652142007 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 0x7f3a18175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/652142007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a1810fbf0 0x7f3a18114c30 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=15947953969582206187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/652142007 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 0x7f3a1810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/652142007 >> 10.20.193.28:0/652142007 conn(0x7f3a180ecb00 msgr2=0x7f3a1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:23.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/652142007 shutdown_connections 2026-02-13T01:27:23.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/652142007 wait complete. 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.087+0000 7f3a1e8546c0 1 Processor -- start 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 -- start start 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 0x7f3a18066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 0x7f3a18175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a18062990 0x7f3a18062e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a180635a0 con 0x7f3a18062990 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a180636e0 con 0x7f3a1810f200 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1e8546c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3a180f4970 con 0x7f3a18115410 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a17fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 0x7f3a18066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a1cdca6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a18062990 0x7f3a18062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a17fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 0x7f3a18066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:54666/0 (socket says 10.20.193.28:54666) 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a17fff6c0 1 -- 10.20.193.28:0/3303096155 learned_addr learned my addr 10.20.193.28:0/3303096155 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.088+0000 7f3a177fe6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 0x7f3a18175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1cdca6c0 1 -- 10.20.193.28:0/3303096155 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 msgr2=0x7f3a18175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1cdca6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 0x7f3a18175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1cdca6c0 1 -- 10.20.193.28:0/3303096155 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 msgr2=0x7f3a18066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1cdca6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 0x7f3a18066730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1cdca6c0 1 -- 10.20.193.28:0/3303096155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a08009590 con 0x7f3a18062990 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a177fe6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 0x7f3a18175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1cdca6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a18062990 0x7f3a18062e10 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a0c00c6c0 tx=0x7f3a0c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a0c005340 con 0x7f3a18062990 2026-02-13T01:27:23.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a0c003cf0 con 0x7f3a18062990 2026-02-13T01:27:23.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a0c00dd50 con 0x7f3a18062990 2026-02-13T01:27:23.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a180f4c50 con 0x7f3a18062990 2026-02-13T01:27:23.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.089+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a180f5130 con 0x7f3a18062990 2026-02-13T01:27:23.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.090+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a181104d0 con 0x7f3a18062990 2026-02-13T01:27:23.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.092+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f3a0c003810 con 0x7f3a18062990 2026-02-13T01:27:23.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.094+0000 7f3a157fa6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39ec0b5680 0x7f39ec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.094+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f3a0c0e4910 con 0x7f3a18062990 2026-02-13T01:27:23.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.094+0000 7f3a17fff6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39ec0b5680 0x7f39ec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.094+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3a0c0e4d90 con 0x7f3a18062990 2026-02-13T01:27:23.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.095+0000 7f3a17fff6c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39ec0b5680 0x7f39ec0d5b30 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a04009260 tx=0x7f3a04009440 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:23.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.219+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3a18063c90 con 0x7f3a18062990 2026-02-13T01:27:23.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.219+0000 7f3a157fa6c0 1 -- 10.20.193.28:0/3303096155 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3a0c0a7340 con 0x7f3a18062990 2026-02-13T01:27:23.220 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:23.220 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:23.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39ec0b5680 msgr2=0x7f39ec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39ec0b5680 0x7f39ec0d5b30 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a04009260 tx=0x7f3a04009440 comp rx=0 tx=0).stop 2026-02-13T01:27:23.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a18062990 msgr2=0x7f3a18062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a18062990 0x7f3a18062e10 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a0c00c6c0 tx=0x7f3a0c00cb90 comp rx=0 tx=0).stop 2026-02-13T01:27:23.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 shutdown_connections 2026-02-13T01:27:23.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f39ec0b5680 0x7f39ec0d5b30 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3a18115410 0x7f3a18175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3a18062990 0x7f3a18062e10 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 --2- 10.20.193.28:0/3303096155 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3a1810f200 0x7f3a18066730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 >> 10.20.193.28:0/3303096155 conn(0x7f3a180ecb00 msgr2=0x7f3a1810d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:23.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 shutdown_connections 2026-02-13T01:27:23.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:23.221+0000 7f3a1e8546c0 1 -- 10.20.193.28:0/3303096155 wait complete. 2026-02-13T01:27:23.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:22 trial134 ceph-mon[27948]: pgmap v254: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:23.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:22 trial187 ceph-mon[27464]: pgmap v254: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:23 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3303096155' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:24.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:23 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3303096155' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:24.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:23 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3303096155' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:25.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:24 trial028 ceph-mon[22984]: pgmap v255: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:24 trial134 ceph-mon[27948]: pgmap v255: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:25.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:24 trial187 ceph-mon[27464]: pgmap v255: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:26.328 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:26.513 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:26.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/3189801277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c112fe0 msgr2=0x7f9d0c173980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 --2- 10.20.193.28:0/3189801277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173980 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=14879680895677146963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d0000aa70 tx=0x7f9d0002fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/3189801277 shutdown_connections 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 --2- 10.20.193.28:0/3189801277 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d0c10d7c0 0x7f9d0c112800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 --2- 10.20.193.28:0/3189801277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173980 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=14879680895677146963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 --2- 10.20.193.28:0/3189801277 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c10cdd0 0x7f9d0c10d1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/3189801277 >> 10.20.193.28:0/3189801277 conn(0x7f9d0c0ea6d0 msgr2=0x7f9d0c10aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/3189801277 shutdown_connections 2026-02-13T01:27:26.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.712+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/3189801277 wait complete. 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 Processor -- start 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 -- start start 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c10cdd0 0x7f9d0c0f48e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d0c0f4f10 0x7f9d0c0fa1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0f5600 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0fa720 con 0x7f9d0c112fe0 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d108ef6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c0fa8e0 con 0x7f9d0c0f4f10 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d0b7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c10cdd0 0x7f9d0c0f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d0affd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:26.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d0affd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:35376/0 (socket says 10.20.193.28:35376) 2026-02-13T01:27:26.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d0affd6c0 1 -- 10.20.193.28:0/2964944654 learned_addr learned my addr 10.20.193.28:0/2964944654 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:26.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.713+0000 7f9d0bfff6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d0c0f4f10 0x7f9d0c0fa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d0b7fe6c0 1 -- 10.20.193.28:0/2964944654 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d0c0f4f10 msgr2=0x7f9d0c0fa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d0b7fe6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d0c0f4f10 0x7f9d0c0fa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d0b7fe6c0 1 -- 10.20.193.28:0/2964944654 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c112fe0 msgr2=0x7f9d0c173880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d0b7fe6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d0b7fe6c0 1 -- 10.20.193.28:0/2964944654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0000a660 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d0b7fe6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c10cdd0 0x7f9d0c0f48e0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf800b640 tx=0x7f9cf800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf80044a0 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/2964944654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c0fabc0 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9cf8009030 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9cf80044a0 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.714+0000 7f9d108ef6c0 1 -- 10.20.193.28:0/2964944654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c0fb350 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.715+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c10e0a0 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.717+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9cf800cac0 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.718+0000 7f9d08ff96c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ce00b5660 0x7f9ce00d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:26.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.718+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f9cf80e35e0 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.719+0000 7f9d0affd6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ce00b5660 0x7f9ce00d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:26.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.719+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9cf80e3a60 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.719+0000 7f9d0affd6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ce00b5660 0x7f9ce00d5b10 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d0c0fb270 tx=0x7f9cfc009420 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:26.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.842+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d0c0f5a30 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.843+0000 7f9d08ff96c0 1 -- 10.20.193.28:0/2964944654 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9cf80a6010 con 0x7f9d0c10cdd0 2026-02-13T01:27:26.843 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:26.844 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:26.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ce00b5660 msgr2=0x7f9ce00d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ce00b5660 0x7f9ce00d5b10 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d0c0fb270 tx=0x7f9cfc009420 comp rx=0 tx=0).stop 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c10cdd0 msgr2=0x7f9d0c0f48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c10cdd0 0x7f9d0c0f48e0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cf800b640 tx=0x7f9cf800bb10 comp rx=0 tx=0).stop 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 shutdown_connections 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9ce00b5660 0x7f9ce00d5b10 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d0c0f4f10 0x7f9d0c0fa1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d0c112fe0 0x7f9d0c173880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 --2- 10.20.193.28:0/2964944654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d0c10cdd0 0x7f9d0c0f48e0 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 >> 10.20.193.28:0/2964944654 conn(0x7f9d0c0ea6d0 msgr2=0x7f9d0c10b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:26.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 shutdown_connections 2026-02-13T01:27:26.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:26.844+0000 7f9ce67fc6c0 1 -- 10.20.193.28:0/2964944654 wait complete. 2026-02-13T01:27:27.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:26 trial028 ceph-mon[22984]: pgmap v256: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:27.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:26 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2964944654' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:26 trial134 ceph-mon[27948]: pgmap v256: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:27.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:26 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2964944654' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:27.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:26 trial187 ceph-mon[27464]: pgmap v256: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:27.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:26 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2964944654' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:29.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:28 trial028 ceph-mon[22984]: pgmap v257: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:29.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:28 trial134 ceph-mon[27948]: pgmap v257: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:29.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:28 trial187 ceph-mon[27464]: pgmap v257: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:29.950 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:30.134 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:30.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.333+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/1230248571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2410fa50 msgr2=0x7f8f24114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.333+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/1230248571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2410fa50 0x7f8f24114a90 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=9319677454890754525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f0c0098d0 tx=0x7f8f0c02ec30 comp rx=0 tx=0).stop 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/1230248571 shutdown_connections 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/1230248571 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8f24115270 0x7f8f24175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/1230248571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f2410fa50 0x7f8f24114a90 unknown :-1 s=CLOSED pgs=258 gs=2 cs=0 l=1 c_cookie=9319677454890754525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/1230248571 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8f2410f060 0x7f8f2410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/1230248571 >> 10.20.193.28:0/1230248571 conn(0x7f8f240ec980 msgr2=0x7f8f2410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/1230248571 shutdown_connections 2026-02-13T01:27:30.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/1230248571 wait complete. 2026-02-13T01:27:30.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.334+0000 7f8f29bb06c0 1 Processor -- start 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 -- start start 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8f2410f060 0x7f8f240f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8f24115270 0x7f8f24175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 0x7f8f240fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f240f56e0 con 0x7f8f240f4ff0 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f240fa7b0 con 0x7f8f24115270 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f29bb06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8f240fa970 con 0x7f8f2410f060 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 0x7f8f240fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 0x7f8f240fa270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44230/0 (socket says 10.20.193.28:44230) 2026-02-13T01:27:30.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 -- 10.20.193.28:0/3347445265 learned_addr learned my addr 10.20.193.28:0/3347445265 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f1bfff6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8f24115270 0x7f8f24175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 -- 10.20.193.28:0/3347445265 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8f2410f060 msgr2=0x7f8f240f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8f2410f060 0x7f8f240f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 -- 10.20.193.28:0/3347445265 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8f24115270 msgr2=0x7f8f24175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8f24115270 0x7f8f24175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.335+0000 7f8f293af6c0 1 -- 10.20.193.28:0/3347445265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c0094c0 con 0x7f8f240f4ff0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.336+0000 7f8f293af6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 0x7f8f240fa270 secure :-1 s=READY pgs=259 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f2000c9b0 tx=0x7f8f2000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.336+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f20003c40 con 0x7f8f240f4ff0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.336+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f240fac50 con 0x7f8f240f4ff0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.336+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f2000a070 con 0x7f8f240f4ff0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.336+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f20003c40 con 0x7f8f240f4ff0 2026-02-13T01:27:30.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.337+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2410c7f0 con 0x7f8f240f4ff0 2026-02-13T01:27:30.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.337+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f240fb130 con 0x7f8f240f4ff0 2026-02-13T01:27:30.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.339+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f8f2000d590 con 0x7f8f240f4ff0 2026-02-13T01:27:30.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.340+0000 7f8f19ffb6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8f000b56e0 0x7f8f000d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.340+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f8f200ab540 con 0x7f8f240f4ff0 2026-02-13T01:27:30.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.340+0000 7f8f28bae6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8f000b56e0 0x7f8f000d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:30.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.341+0000 7f8f28bae6c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8f000b56e0 0x7f8f000d5b90 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f14004750 tx=0x7f8f14005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:30.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.343+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8f200a73c0 con 0x7f8f240f4ff0 2026-02-13T01:27:30.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.467+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f240f5ac0 con 0x7f8f240f4ff0 2026-02-13T01:27:30.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.467+0000 7f8f19ffb6c0 1 -- 10.20.193.28:0/3347445265 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8f200a7560 con 0x7f8f240f4ff0 2026-02-13T01:27:30.468 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:30.468 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:30.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.468+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8f000b56e0 msgr2=0x7f8f000d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.468+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8f000b56e0 0x7f8f000d5b90 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f14004750 tx=0x7f8f14005f10 comp rx=0 tx=0).stop 2026-02-13T01:27:30.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.468+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 msgr2=0x7f8f240fa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.468+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 0x7f8f240fa270 secure :-1 s=READY pgs=259 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f2000c9b0 tx=0x7f8f2000ce80 comp rx=0 tx=0).stop 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 shutdown_connections 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f240f4ff0 0x7f8f240fa270 unknown :-1 s=CLOSED pgs=259 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8f24115270 0x7f8f24175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8f000b56e0 0x7f8f000d5b90 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 --2- 10.20.193.28:0/3347445265 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8f2410f060 0x7f8f240f49c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 >> 10.20.193.28:0/3347445265 conn(0x7f8f240ec980 msgr2=0x7f8f2410d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 shutdown_connections 2026-02-13T01:27:30.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:30.469+0000 7f8f29bb06c0 1 -- 10.20.193.28:0/3347445265 wait complete. 2026-02-13T01:27:31.195 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:30 trial187 ceph-mon[27464]: pgmap v258: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:31.195 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:30 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3347445265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:30 trial028 ceph-mon[22984]: pgmap v258: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:30 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3347445265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:31.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:30 trial134 ceph-mon[27948]: pgmap v258: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:31.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:30 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3347445265' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:33.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:32 trial028 ceph-mon[22984]: pgmap v259: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:33.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:32 trial134 ceph-mon[27948]: pgmap v259: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:33.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:32 trial187 ceph-mon[27464]: pgmap v259: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:33.572 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:33.758 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 -- 10.20.193.28:0/899310796 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4541137a0 msgr2=0x7fc454113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/899310796 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4541137a0 0x7fc454113b70 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=12923831150492195489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4440098a0 tx=0x7fc44402ec50 comp rx=0 tx=0).stop 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 -- 10.20.193.28:0/899310796 shutdown_connections 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/899310796 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4541198f0 0x7fc45417a2c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/899310796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc454114190 0x7fc454119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/899310796 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4541137a0 0x7fc454113b70 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=12923831150492195489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 -- 10.20.193.28:0/899310796 >> 10.20.193.28:0/899310796 conn(0x7fc454060760 msgr2=0x7fc454060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.963+0000 7fc45c6486c0 1 -- 10.20.193.28:0/899310796 shutdown_connections 2026-02-13T01:27:33.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.964+0000 7fc45c6486c0 1 -- 10.20.193.28:0/899310796 wait complete. 2026-02-13T01:27:33.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.964+0000 7fc45c6486c0 1 Processor -- start 2026-02-13T01:27:33.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.964+0000 7fc45c6486c0 1 -- start start 2026-02-13T01:27:33.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45c6486c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4541137a0 0x7fc454121690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:33.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45c6486c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 0x7fc454121bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45c6486c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc454126f90 0x7fc454127430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45c6486c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541279a0 con 0x7fc4541198f0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45c6486c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc454127b10 con 0x7fc454126f90 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45c6486c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc454127cd0 con 0x7fc4541137a0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 0x7fc454121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 0x7fc454121bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44244/0 (socket says 10.20.193.28:44244) 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 -- 10.20.193.28:0/3072988911 learned_addr learned my addr 10.20.193.28:0/3072988911 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45a3b96c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4541137a0 0x7fc454121690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45abba6c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc454126f90 0x7fc454127430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 -- 10.20.193.28:0/3072988911 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4541137a0 msgr2=0x7fc454121690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4541137a0 0x7fc454121690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 -- 10.20.193.28:0/3072988911 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc454126f90 msgr2=0x7fc454127430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc454126f90 0x7fc454127430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 -- 10.20.193.28:0/3072988911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc448009590 con 0x7fc4541198f0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc45abba6c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc454126f90 0x7fc454127430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc459bb86c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 0x7fc454121bd0 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc448004750 tx=0x7fc44800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.965+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4480044a0 con 0x7fc4541198f0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.966+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45000a5b0 con 0x7fc4541198f0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.966+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc448009030 con 0x7fc4541198f0 2026-02-13T01:27:33.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.966+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4480071c0 con 0x7fc4541198f0 2026-02-13T01:27:33.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.966+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4440094c0 con 0x7fc4541198f0 2026-02-13T01:27:33.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.966+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4541149e0 con 0x7fc4541198f0 2026-02-13T01:27:33.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.968+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fc4480026b0 con 0x7fc4541198f0 2026-02-13T01:27:33.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.970+0000 7fc43b7fe6c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc4300b5680 0x7fc4300d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:33.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.970+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fc4480e3c50 con 0x7fc4541198f0 2026-02-13T01:27:33.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.970+0000 7fc45a3b96c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc4300b5680 0x7fc4300d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:33.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.970+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc4480e40d0 con 0x7fc4541198f0 2026-02-13T01:27:33.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:33.970+0000 7fc45a3b96c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc4300b5680 0x7fc4300d5b30 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4440097f0 tx=0x7fc4440023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:34.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.096+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc454113b70 con 0x7fc4541198f0 2026-02-13T01:27:34.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.096+0000 7fc43b7fe6c0 1 -- 10.20.193.28:0/3072988911 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc4480a6680 con 0x7fc4541198f0 2026-02-13T01:27:34.096 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:34.096 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc4300b5680 msgr2=0x7fc4300d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc4300b5680 0x7fc4300d5b30 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4440097f0 tx=0x7fc4440023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 msgr2=0x7fc454121bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 0x7fc454121bd0 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc448004750 tx=0x7fc44800be00 comp rx=0 tx=0).stop 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 shutdown_connections 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc454126f90 0x7fc454127430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4541198f0 0x7fc454121bd0 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc4300b5680 0x7fc4300d5b30 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 --2- 10.20.193.28:0/3072988911 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4541137a0 0x7fc454121690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 >> 10.20.193.28:0/3072988911 conn(0x7fc454060760 msgr2=0x7fc454115820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 shutdown_connections 2026-02-13T01:27:34.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:34.097+0000 7fc45c6486c0 1 -- 10.20.193.28:0/3072988911 wait complete. 2026-02-13T01:27:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:34 trial028 ceph-mon[22984]: pgmap v260: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:34 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3072988911' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:35.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:34 trial134 ceph-mon[27948]: pgmap v260: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:35.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:34 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3072988911' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:34 trial187 ceph-mon[27464]: pgmap v260: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:27:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:34 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3072988911' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:36 trial028 ceph-mon[22984]: pgmap v261: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:37.197 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:37.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:36 trial134 ceph-mon[27948]: pgmap v261: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:37.383 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:36 trial187 ceph-mon[27464]: pgmap v261: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:37.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 -- 10.20.193.28:0/1944655615 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f555410f200 msgr2=0x7f555410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 --2- 10.20.193.28:0/1944655615 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f555410f200 0x7f555410f5d0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=4846922262425793092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55400099a0 tx=0x7f554002ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 -- 10.20.193.28:0/1944655615 shutdown_connections 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 --2- 10.20.193.28:0/1944655615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5554115410 0x7f5554175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 --2- 10.20.193.28:0/1944655615 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410fbf0 0x7f5554114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 --2- 10.20.193.28:0/1944655615 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f555410f200 0x7f555410f5d0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=4846922262425793092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 -- 10.20.193.28:0/1944655615 >> 10.20.193.28:0/1944655615 conn(0x7f55540ecb00 msgr2=0x7f555410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 -- 10.20.193.28:0/1944655615 shutdown_connections 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.583+0000 7f555a7546c0 1 -- 10.20.193.28:0/1944655615 wait complete. 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 Processor -- start 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 -- start start 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410f200 0x7f555410cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5554115410 0x7f5554175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 0x7f555410a6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f555410aeb0 con 0x7f555410a260 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f555410b020 con 0x7f555410f200 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f555a7546c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f55540eff00 con 0x7f5554115410 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f5558cc66c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 0x7f555410a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f5558cc66c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 0x7f555410a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48192/0 (socket says 10.20.193.28:48192) 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f5558cc66c0 1 -- 10.20.193.28:0/421713515 learned_addr learned my addr 10.20.193.28:0/421713515 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.584+0000 7f55537fe6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5554115410 0x7f5554175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5553fff6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410f200 0x7f555410cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5558cc66c0 1 -- 10.20.193.28:0/421713515 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5554115410 msgr2=0x7f5554175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5558cc66c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5554115410 0x7f5554175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5558cc66c0 1 -- 10.20.193.28:0/421713515 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410f200 msgr2=0x7f555410cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5558cc66c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410f200 0x7f555410cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5558cc66c0 1 -- 10.20.193.28:0/421713515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5540009590 con 0x7f555410a260 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f55537fe6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5554115410 0x7f5554175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5553fff6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410f200 0x7f555410cff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f5558cc66c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 0x7f555410a6d0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5548006ea0 tx=0x7f554800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5548003c40 con 0x7f555410a260 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5548003da0 con 0x7f555410a260 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55480081c0 con 0x7f555410a260 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55540f0180 con 0x7f555410a260 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.585+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55540f0610 con 0x7f555410a260 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.586+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55541104d0 con 0x7f555410a260 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.589+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f554800d590 con 0x7f555410a260 2026-02-13T01:27:37.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.590+0000 7f55517fa6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55280b5680 0x7f55280d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.590+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f55480e4b50 con 0x7f555410a260 2026-02-13T01:27:37.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.591+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f554811d5e0 con 0x7f555410a260 2026-02-13T01:27:37.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.591+0000 7f5553fff6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55280b5680 0x7f55280d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.591+0000 7f5553fff6c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55280b5680 0x7f55280d5b30 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5540009970 tx=0x7f55400023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:37.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.717+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f555410f5d0 con 0x7f555410a260 2026-02-13T01:27:37.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.718+0000 7f55517fa6c0 1 -- 10.20.193.28:0/421713515 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f55480a7580 con 0x7f555410a260 2026-02-13T01:27:37.718 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:37.718 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:37.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.719+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55280b5680 msgr2=0x7f55280d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.719+0000 7f555a7546c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55280b5680 0x7f55280d5b30 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5540009970 tx=0x7f55400023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.719+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 msgr2=0x7f555410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 0x7f555410a6d0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5548006ea0 tx=0x7f554800ce50 comp rx=0 tx=0).stop 2026-02-13T01:27:37.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 shutdown_connections 2026-02-13T01:27:37.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f55280b5680 0x7f55280d5b30 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f5554115410 0x7f5554175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f555410a260 0x7f555410a6d0 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 --2- 10.20.193.28:0/421713515 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f555410f200 0x7f555410cff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 >> 10.20.193.28:0/421713515 conn(0x7f55540ecb00 msgr2=0x7f5554112d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:37.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 shutdown_connections 2026-02-13T01:27:37.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:37.720+0000 7f555a7546c0 1 -- 10.20.193.28:0/421713515 wait complete. 2026-02-13T01:27:38.072 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:37 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:38.072 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:37 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/421713515' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:37 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:38.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:37 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/421713515' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:38.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:37 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:38.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:37 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/421713515' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: pgmap v262: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:38 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: pgmap v262: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:38 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: pgmap v262: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:39.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:39.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:38 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:40.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:40.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:40.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:40.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:40.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:40.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:39 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:40.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:39 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:40.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:40.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:40.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:27:40.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:40.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:40.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:39 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:40.833 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:41.016 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:41.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:40 trial028 ceph-mon[22984]: pgmap v263: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:41.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:40 trial028 ceph-mon[22984]: pgmap v264: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:27:41.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:40 trial028 ceph-mon[22984]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:27:41.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:40 trial028 ceph-mon[22984]: Cluster is now healthy 2026-02-13T01:27:41.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/1570425060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 msgr2=0x7ff8f4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/1570425060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f4113b70 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=1503839915588985290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e40099a0 tx=0x7ff8e402ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/1570425060 shutdown_connections 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/1570425060 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4114190 0x7ff8f4115d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/1570425060 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8f4116520 0x7ff8f417a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/1570425060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f4113b70 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=1503839915588985290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/1570425060 >> 10.20.193.28:0/1570425060 conn(0x7ff8f4061510 msgr2=0x7ff8f4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/1570425060 shutdown_connections 2026-02-13T01:27:41.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.218+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/1570425060 wait complete. 2026-02-13T01:27:41.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 Processor -- start 2026-02-13T01:27:41.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 -- start start 2026-02-13T01:27:41.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f41214e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:41.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4116520 0x7ff8f4121a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:41.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8f4126de0 0x7ff8f4127280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f41277f0 con 0x7ff8f41137a0 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4127960 con 0x7ff8f4126de0 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8fa89b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4127b20 con 0x7ff8f4116520 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8f98996c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f41214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8f98996c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f41214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48220/0 (socket says 10.20.193.28:48220) 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.219+0000 7ff8f98996c0 1 -- 10.20.193.28:0/2004125692 learned_addr learned my addr 10.20.193.28:0/2004125692 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f90986c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4116520 0x7ff8f4121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8fa09a6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8f4126de0 0x7ff8f4127280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f98996c0 1 -- 10.20.193.28:0/2004125692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4116520 msgr2=0x7ff8f4121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f98996c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4116520 0x7ff8f4121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f98996c0 1 -- 10.20.193.28:0/2004125692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8f4126de0 msgr2=0x7ff8f4127280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f98996c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8f4126de0 0x7ff8f4127280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f98996c0 1 -- 10.20.193.28:0/2004125692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e4009590 con 0x7ff8f41137a0 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f90986c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4116520 0x7ff8f4121a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8f98996c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f41214e0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e4031fd0 tx=0x7ff8e402fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e4002ae0 con 0x7ff8f41137a0 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f4167f70 con 0x7ff8f41137a0 2026-02-13T01:27:41.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8e40046b0 con 0x7ff8f41137a0 2026-02-13T01:27:41.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8e4037520 con 0x7ff8f41137a0 2026-02-13T01:27:41.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.220+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f41683f0 con 0x7ff8f41137a0 2026-02-13T01:27:41.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.221+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f4114840 con 0x7ff8f41137a0 2026-02-13T01:27:41.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.223+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ff8e4002c40 con 0x7ff8f41137a0 2026-02-13T01:27:41.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.225+0000 7ff8e2ffd6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8d00b5680 0x7ff8d00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:41.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.225+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7ff8e4107c00 con 0x7ff8f41137a0 2026-02-13T01:27:41.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.225+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8e4140660 con 0x7ff8f41137a0 2026-02-13T01:27:41.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.225+0000 7ff8f90986c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8d00b5680 0x7ff8d00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:41.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.226+0000 7ff8f90986c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8d00b5680 0x7ff8d00d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f4127e70 tx=0x7ff8e8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:41.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:40 trial134 ceph-mon[27948]: pgmap v263: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:41.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:40 trial134 ceph-mon[27948]: pgmap v264: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:27:41.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:40 trial134 ceph-mon[27948]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:27:41.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:40 trial134 ceph-mon[27948]: Cluster is now healthy 2026-02-13T01:27:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.350+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8f4114190 con 0x7ff8f41137a0 2026-02-13T01:27:41.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.350+0000 7ff8e2ffd6c0 1 -- 10.20.193.28:0/2004125692 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8e40ca630 con 0x7ff8f41137a0 2026-02-13T01:27:41.351 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:41.351 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8d00b5680 msgr2=0x7ff8d00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8d00b5680 0x7ff8d00d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f4127e70 tx=0x7ff8e8009260 comp rx=0 tx=0).stop 2026-02-13T01:27:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 msgr2=0x7ff8f41214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f41214e0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e4031fd0 tx=0x7ff8e402fc80 comp rx=0 tx=0).stop 2026-02-13T01:27:41.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 shutdown_connections 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff8d00b5680 0x7ff8d00d5b30 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8f4116520 0x7ff8f4121a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8f4126de0 0x7ff8f4127280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 --2- 10.20.193.28:0/2004125692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8f41137a0 0x7ff8f41214e0 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 >> 10.20.193.28:0/2004125692 conn(0x7ff8f4061510 msgr2=0x7ff8f4116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 shutdown_connections 2026-02-13T01:27:41.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:41.351+0000 7ff8fa89b6c0 1 -- 10.20.193.28:0/2004125692 wait complete. 2026-02-13T01:27:41.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:40 trial187 ceph-mon[27464]: pgmap v263: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:41.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:40 trial187 ceph-mon[27464]: pgmap v264: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 5 op/s 2026-02-13T01:27:41.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:40 trial187 ceph-mon[27464]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:27:41.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:40 trial187 ceph-mon[27464]: Cluster is now healthy 2026-02-13T01:27:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:41 trial028 ceph-mon[22984]: pgmap v265: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:41 trial028 ceph-mon[22984]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:27:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:41 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2004125692' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:42.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:41 trial134 ceph-mon[27948]: pgmap v265: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:42.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:41 trial134 ceph-mon[27948]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:27:42.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:41 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2004125692' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:42.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:41 trial187 ceph-mon[27464]: pgmap v265: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:42.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:41 trial187 ceph-mon[27464]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:27:42.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:41 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2004125692' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:43 trial028 ceph-mon[22984]: pgmap v266: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:27:44.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:43 trial134 ceph-mon[27948]: pgmap v266: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:27:44.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:43 trial187 ceph-mon[27464]: pgmap v266: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-13T01:27:44.454 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:44.639 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:44.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 -- 10.20.193.28:0/2661568394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118114190 msgr2=0x7f6118115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2661568394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118114190 0x7f6118115d40 secure :-1 s=READY pgs=264 gs=3 cs=0 l=1 c_cookie=6200111795681904675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f610c0098d0 tx=0x7f610c02ec30 comp rx=0 tx=0).stop 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 -- 10.20.193.28:0/2661568394 shutdown_connections 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2661568394 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f6118116520 0x7f611817a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2661568394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118114190 0x7f6118115d40 unknown :-1 s=CLOSED pgs=264 gs=3 cs=0 l=1 c_cookie=6200111795681904675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2661568394 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f61181137a0 0x7f6118113b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 -- 10.20.193.28:0/2661568394 >> 10.20.193.28:0/2661568394 conn(0x7f6118061510 msgr2=0x7f6118061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 -- 10.20.193.28:0/2661568394 shutdown_connections 2026-02-13T01:27:44.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.834+0000 7f611f0326c0 1 -- 10.20.193.28:0/2661568394 wait complete. 2026-02-13T01:27:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 Processor -- start 2026-02-13T01:27:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 -- start start 2026-02-13T01:27:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 0x7f611806e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118116520 0x7f611817a000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f611806e8b0 0x7f6118108d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f611806efa0 con 0x7f6118116520 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6118109290 con 0x7f611806e8b0 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.835+0000 7f611f0326c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6118109450 con 0x7f61181137a0 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611d82f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118116520 0x7f611817a000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 0x7f611806e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 0x7f611806e280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:35206/0 (socket says 10.20.193.28:35206) 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 -- 10.20.193.28:0/2966268692 learned_addr learned my addr 10.20.193.28:0/2966268692 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e8316c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f611806e8b0 0x7f6118108d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 -- 10.20.193.28:0/2966268692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f611806e8b0 msgr2=0x7f6118108d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f611806e8b0 0x7f6118108d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 -- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118116520 msgr2=0x7f611817a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118116520 0x7f611817a000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 -- 10.20.193.28:0/2966268692 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6108009590 con 0x7f61181137a0 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f611e0306c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 0x7f611806e280 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f610800ba30 tx=0x7f610800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.836+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61080044a0 con 0x7f61181137a0 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.837+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c0094c0 con 0x7f61181137a0 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.837+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6108009030 con 0x7f61181137a0 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.837+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f610800ce90 con 0x7f61181137a0 2026-02-13T01:27:44.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.837+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6118109a80 con 0x7f61181137a0 2026-02-13T01:27:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.837+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6118114840 con 0x7f61181137a0 2026-02-13T01:27:44.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.839+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f61080026b0 con 0x7f61181137a0 2026-02-13T01:27:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.841+0000 7f60ff7fe6c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f60f40b5600 0x7f60f40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.841+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f61080e3c00 con 0x7f61181137a0 2026-02-13T01:27:44.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.841+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f610811c660 con 0x7f61181137a0 2026-02-13T01:27:44.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.841+0000 7f611d82f6c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f60f40b5600 0x7f60f40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.842+0000 7f611d82f6c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f60f40b5600 0x7f60f40d5ab0 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118109de0 tx=0x7f610c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.967+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f611806f400 con 0x7f61181137a0 2026-02-13T01:27:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.967+0000 7f60ff7fe6c0 1 -- 10.20.193.28:0/2966268692 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f61080a6630 con 0x7f61181137a0 2026-02-13T01:27:44.968 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:44.968 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.968+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f60f40b5600 msgr2=0x7f60f40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.968+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f60f40b5600 0x7f60f40d5ab0 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118109de0 tx=0x7f610c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.968+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 msgr2=0x7f611806e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.968+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 0x7f611806e280 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f610800ba30 tx=0x7f610800be30 comp rx=0 tx=0).stop 2026-02-13T01:27:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 shutdown_connections 2026-02-13T01:27:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f611806e8b0 0x7f6118108d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6118116520 0x7f611817a000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f60f40b5600 0x7f60f40d5ab0 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 --2- 10.20.193.28:0/2966268692 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f61181137a0 0x7f611806e280 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 >> 10.20.193.28:0/2966268692 conn(0x7f6118061510 msgr2=0x7f6118114d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 shutdown_connections 2026-02-13T01:27:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:44.969+0000 7f611f0326c0 1 -- 10.20.193.28:0/2966268692 wait complete. 2026-02-13T01:27:46.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:45 trial028 ceph-mon[22984]: pgmap v267: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:46.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:45 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2966268692' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:46.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:45 trial134 ceph-mon[27948]: pgmap v267: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:46.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:45 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2966268692' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:46.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:45 trial187 ceph-mon[27464]: pgmap v267: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:46.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:45 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2966268692' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:48.072 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:48.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:47 trial028 ceph-mon[22984]: pgmap v268: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:48.257 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:48.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:47 trial134 ceph-mon[27948]: pgmap v268: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:48.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:47 trial187 ceph-mon[27464]: pgmap v268: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 -- 10.20.193.28:0/448494589 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c410fa50 msgr2=0x7f68c4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/448494589 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c410fa50 0x7f68c4114a90 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=3909627373625153352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b4009970 tx=0x7f68b402ed10 comp rx=0 tx=0).stop 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 -- 10.20.193.28:0/448494589 shutdown_connections 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/448494589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c4115270 0x7f68c4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/448494589 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c410fa50 0x7f68c4114a90 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=3909627373625153352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/448494589 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c410f060 0x7f68c410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 -- 10.20.193.28:0/448494589 >> 10.20.193.28:0/448494589 conn(0x7f68c40ec980 msgr2=0x7f68c410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:48.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 -- 10.20.193.28:0/448494589 shutdown_connections 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.454+0000 7f68c954b6c0 1 -- 10.20.193.28:0/448494589 wait complete. 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 Processor -- start 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 -- start start 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c410f060 0x7f68c40f49a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c4115270 0x7f68c4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c40f4fd0 0x7f68c40fa2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40f56c0 con 0x7f68c410f060 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40fa7e0 con 0x7f68c4115270 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c954b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40fa9a0 con 0x7f68c40f4fd0 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.455+0000 7f68c37fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c4115270 0x7f68c4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c8d4a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c40f4fd0 0x7f68c40fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:48.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c8d4a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c40f4fd0 0x7f68c40fa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:40596/0 (socket says 10.20.193.28:40596) 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c8d4a6c0 1 -- 10.20.193.28:0/4059693442 learned_addr learned my addr 10.20.193.28:0/4059693442 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c3fff6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c410f060 0x7f68c40f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c37fe6c0 1 -- 10.20.193.28:0/4059693442 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c40f4fd0 msgr2=0x7f68c40fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c37fe6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c40f4fd0 0x7f68c40fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c37fe6c0 1 -- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c410f060 msgr2=0x7f68c40f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c37fe6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c410f060 0x7f68c40f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c37fe6c0 1 -- 10.20.193.28:0/4059693442 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b4009590 con 0x7f68c4115270 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c37fe6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c4115270 0x7f68c4175b10 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b4009970 tx=0x7f68b40047f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68b4002ae0 con 0x7f68c4115270 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68b4002c40 con 0x7f68c4115270 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c40fac20 con 0x7f68c4115270 2026-02-13T01:27:48.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68b40372f0 con 0x7f68c4115270 2026-02-13T01:27:48.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.456+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c40fb0a0 con 0x7f68c4115270 2026-02-13T01:27:48.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.457+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c4110330 con 0x7f68c4115270 2026-02-13T01:27:48.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.459+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f68b4007860 con 0x7f68c4115270 2026-02-13T01:27:48.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.460+0000 7f68c17fa6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f68980b5600 0x7f68980d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:48.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.461+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f68b4107c70 con 0x7f68c4115270 2026-02-13T01:27:48.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.461+0000 7f68c3fff6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f68980b5600 0x7f68980d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:48.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.461+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f68b41080f0 con 0x7f68c4115270 2026-02-13T01:27:48.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.461+0000 7f68c3fff6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f68980b5600 0x7f68980d5ab0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b0004750 tx=0x7f68b0009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:48.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.586+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68c410f430 con 0x7f68c4115270 2026-02-13T01:27:48.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.586+0000 7f68c17fa6c0 1 -- 10.20.193.28:0/4059693442 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f68b40ca6a0 con 0x7f68c4115270 2026-02-13T01:27:48.587 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:48.587 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f68980b5600 msgr2=0x7f68980d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f68980b5600 0x7f68980d5ab0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b0004750 tx=0x7f68b0009390 comp rx=0 tx=0).stop 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c4115270 msgr2=0x7f68c4175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c4115270 0x7f68c4175b10 secure :-1 s=READY pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b4009970 tx=0x7f68b40047f0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 shutdown_connections 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f68980b5600 0x7f68980d5ab0 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f68c40f4fd0 0x7f68c40fa2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f68c4115270 0x7f68c4175b10 unknown :-1 s=CLOSED pgs=115 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 --2- 10.20.193.28:0/4059693442 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c410f060 0x7f68c40f49a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:48.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 >> 10.20.193.28:0/4059693442 conn(0x7f68c40ec980 msgr2=0x7f68c4113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:48.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 shutdown_connections 2026-02-13T01:27:48.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:48.587+0000 7f68c954b6c0 1 -- 10.20.193.28:0/4059693442 wait complete. 2026-02-13T01:27:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:48 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4059693442' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:49.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:48 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4059693442' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:49.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:48 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4059693442' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:49 trial028 ceph-mon[22984]: pgmap v269: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:50.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:49 trial134 ceph-mon[27948]: pgmap v269: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:50.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:49 trial187 ceph-mon[27464]: pgmap v269: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:27:51.693 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:51.879 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:52.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:51 trial028 ceph-mon[22984]: pgmap v270: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:27:52.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 -- 10.20.193.28:0/841106280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 msgr2=0x7f246810f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 --2- 10.20.193.28:0/841106280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 0x7f246810f5e0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=1112167274491935501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f245c0099a0 tx=0x7f245c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 -- 10.20.193.28:0/841106280 shutdown_connections 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 --2- 10.20.193.28:0/841106280 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468115420 0x7f2468175dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 --2- 10.20.193.28:0/841106280 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f246810fc00 0x7f2468114c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 --2- 10.20.193.28:0/841106280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 0x7f246810f5e0 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=1112167274491935501 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 -- 10.20.193.28:0/841106280 >> 10.20.193.28:0/841106280 conn(0x7f24680ecb30 msgr2=0x7f246810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 -- 10.20.193.28:0/841106280 shutdown_connections 2026-02-13T01:27:52.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.071+0000 7f246ca296c0 1 -- 10.20.193.28:0/841106280 wait complete. 2026-02-13T01:27:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 Processor -- start 2026-02-13T01:27:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 -- start start 2026-02-13T01:27:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 0x7f246811d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:52.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2468115420 0x7f246811d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468122a80 0x7f2468122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2468123490 con 0x7f246810f210 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2468123600 con 0x7f2468115420 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f246ca296c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f24681237c0 con 0x7f2468122a80 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f2465d746c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2468115420 0x7f246811d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f2466d766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468122a80 0x7f2468122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f2465d746c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2468115420 0x7f246811d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:41002/0 (socket says 10.20.193.28:41002) 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f2465d746c0 1 -- 10.20.193.28:0/2407740030 learned_addr learned my addr 10.20.193.28:0/2407740030 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.072+0000 7f24665756c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 0x7f246811d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f2466d766c0 1 -- 10.20.193.28:0/2407740030 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2468115420 msgr2=0x7f246811d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:52.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f2466d766c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2468115420 0x7f246811d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f2466d766c0 1 -- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 msgr2=0x7f246811d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f2466d766c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 0x7f246811d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f2466d766c0 1 -- 10.20.193.28:0/2407740030 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c009590 con 0x7f2468122a80 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f2466d766c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468122a80 0x7f2468122f20 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2458006fd0 tx=0x7f245800cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2458003c40 con 0x7f2468122a80 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f245800a070 con 0x7f2468122a80 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f245800dd90 con 0x7f2468122a80 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2468163c70 con 0x7f2468122a80 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.073+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2468164100 con 0x7f2468122a80 2026-02-13T01:27:52.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.074+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24681104e0 con 0x7f2468122a80 2026-02-13T01:27:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.076+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f2458005030 con 0x7f2468122a80 2026-02-13T01:27:52.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.077+0000 7f244f7fe6c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f24400b5700 0x7f24400d5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:52.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.077+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f24580e4960 con 0x7f2468122a80 2026-02-13T01:27:52.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.077+0000 7f24665756c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f24400b5700 0x7f24400d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:52.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.078+0000 7f24665756c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f24400b5700 0x7f24400d5bb0 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f245c005b40 tx=0x7f245c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:52.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.078+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f24580a7390 con 0x7f2468122a80 2026-02-13T01:27:52.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.203+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f246810f5e0 con 0x7f2468122a80 2026-02-13T01:27:52.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.203+0000 7f244f7fe6c0 1 -- 10.20.193.28:0/2407740030 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f24580aa540 con 0x7f2468122a80 2026-02-13T01:27:52.204 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:52.204 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:52.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.204+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f24400b5700 msgr2=0x7f24400d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:52.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.204+0000 7f246ca296c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f24400b5700 0x7f24400d5bb0 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f245c005b40 tx=0x7f245c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.204+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468122a80 msgr2=0x7f2468122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:52.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.204+0000 7f246ca296c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468122a80 0x7f2468122f20 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2458006fd0 tx=0x7f245800cc00 comp rx=0 tx=0).stop 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 shutdown_connections 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f24400b5700 0x7f24400d5bb0 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2468122a80 0x7f2468122f20 unknown :-1 s=CLOSED pgs=105 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2468115420 0x7f246811d6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 --2- 10.20.193.28:0/2407740030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f246810f210 0x7f246811d180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 >> 10.20.193.28:0/2407740030 conn(0x7f24680ecb30 msgr2=0x7f246810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 shutdown_connections 2026-02-13T01:27:52.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:52.205+0000 7f246ca296c0 1 -- 10.20.193.28:0/2407740030 wait complete. 2026-02-13T01:27:52.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:51 trial134 ceph-mon[27948]: pgmap v270: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:27:52.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:51 trial187 ceph-mon[27464]: pgmap v270: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:27:53.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:52 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2407740030' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:53.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:52 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2407740030' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:53.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:52 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2407740030' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:54.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:53 trial028 ceph-mon[22984]: pgmap v271: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:54.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:53 trial134 ceph-mon[27948]: pgmap v271: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:54.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:53 trial187 ceph-mon[27464]: pgmap v271: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:55.311 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:55.498 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/1715711180 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b810f060 msgr2=0x7fc4b810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/1715711180 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b810f060 0x7fc4b810f430 secure :-1 s=READY pgs=116 gs=2 cs=0 l=1 c_cookie=6560051919955772257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a40098a0 tx=0x7fc4a402ec50 comp rx=0 tx=0).stop 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/1715711180 shutdown_connections 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/1715711180 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4b8115270 0x7fc4b8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/1715711180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810fa50 0x7fc4b8114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/1715711180 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b810f060 0x7fc4b810f430 unknown :-1 s=CLOSED pgs=116 gs=2 cs=0 l=1 c_cookie=6560051919955772257 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/1715711180 >> 10.20.193.28:0/1715711180 conn(0x7fc4b80ec980 msgr2=0x7fc4b810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/1715711180 shutdown_connections 2026-02-13T01:27:55.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.681+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/1715711180 wait complete. 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 Processor -- start 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 -- start start 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 0x7fc4b8066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4b8115270 0x7fc4b8062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b8062f70 0x7fc4b8063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b81678f0 con 0x7fc4b810f060 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b811ccd0 con 0x7fc4b8062f70 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bd0876c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b811ce90 con 0x7fc4b8115270 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4b7fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 0x7fc4b8066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4b7fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 0x7fc4b8066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39626/0 (socket says 10.20.193.28:39626) 2026-02-13T01:27:55.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4b7fff6c0 1 -- 10.20.193.28:0/3486312607 learned_addr learned my addr 10.20.193.28:0/3486312607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4bc8866c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b8062f70 0x7fc4b8063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.682+0000 7fc4b77fe6c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4b8115270 0x7fc4b8062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bc8866c0 1 -- 10.20.193.28:0/3486312607 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4b8115270 msgr2=0x7fc4b8062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bc8866c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4b8115270 0x7fc4b8062990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bc8866c0 1 -- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 msgr2=0x7fc4b8066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bc8866c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 0x7fc4b8066730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bc8866c0 1 -- 10.20.193.28:0/3486312607 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a8009590 con 0x7fc4b8062f70 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4b7fff6c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 0x7fc4b8066730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bc8866c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b8062f70 0x7fc4b8063410 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4ac003c40 con 0x7fc4b8062f70 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4ac00a070 con 0x7fc4b8062f70 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4ac00dd90 con 0x7fc4b8062f70 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a40094c0 con 0x7fc4b8062f70 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.683+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b811d470 con 0x7fc4b8062f70 2026-02-13T01:27:55.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.684+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b8110330 con 0x7fc4b8062f70 2026-02-13T01:27:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.686+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fc4ac005030 con 0x7fc4b8062f70 2026-02-13T01:27:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.688+0000 7fc4b57fa6c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc48c0b5680 0x7fc48c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.688+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fc4ac0e48f0 con 0x7fc4b8062f70 2026-02-13T01:27:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.688+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc4ac0e4d70 con 0x7fc4b8062f70 2026-02-13T01:27:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.688+0000 7fc4b7fff6c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc48c0b5680 0x7fc48c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:55.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.689+0000 7fc4b7fff6c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc48c0b5680 0x7fc48c0d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a4004830 tx=0x7fc4a40091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.811+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc4b810f430 con 0x7fc4b8062f70 2026-02-13T01:27:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.812+0000 7fc4b57fa6c0 1 -- 10.20.193.28:0/3486312607 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc4ac0a7320 con 0x7fc4b8062f70 2026-02-13T01:27:55.812 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:55.812 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc48c0b5680 msgr2=0x7fc48c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc48c0b5680 0x7fc48c0d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a4004830 tx=0x7fc4a40091a0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b8062f70 msgr2=0x7fc4b8063410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b8062f70 0x7fc4b8063410 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac00cc00 comp rx=0 tx=0).stop 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 shutdown_connections 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc48c0b5680 0x7fc48c0d5b30 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc4b8115270 0x7fc4b8062990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc4b8062f70 0x7fc4b8063410 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 --2- 10.20.193.28:0/3486312607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4b810f060 0x7fc4b8066730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 >> 10.20.193.28:0/3486312607 conn(0x7fc4b80ec980 msgr2=0x7fc4b810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 shutdown_connections 2026-02-13T01:27:55.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:55.813+0000 7fc4bd0876c0 1 -- 10.20.193.28:0/3486312607 wait complete. 2026-02-13T01:27:56.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:55 trial028 ceph-mon[22984]: pgmap v272: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:56.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:55 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3486312607' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:56.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:55 trial134 ceph-mon[27948]: pgmap v272: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:56.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:55 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3486312607' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:56.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:55 trial187 ceph-mon[27464]: pgmap v272: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:27:56.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:55 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3486312607' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:58.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:57 trial134 ceph-mon[27948]: pgmap v273: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:58.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:57 trial187 ceph-mon[27464]: pgmap v273: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:58.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:57 trial028 ceph-mon[22984]: pgmap v273: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:27:58.916 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:59.101 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:27:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 -- 10.20.193.28:0/2647838508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 msgr2=0x7f102010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/2647838508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102010f430 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=10941051144029849282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10140099a0 tx=0x7f101402ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 -- 10.20.193.28:0/2647838508 shutdown_connections 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/2647838508 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1020115270 0x7f1020175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/2647838508 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f102010fa50 0x7f1020114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/2647838508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102010f430 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=10941051144029849282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 -- 10.20.193.28:0/2647838508 >> 10.20.193.28:0/2647838508 conn(0x7f10200ec980 msgr2=0x7f102010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 -- 10.20.193.28:0/2647838508 shutdown_connections 2026-02-13T01:27:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.299+0000 7f101ffff6c0 1 -- 10.20.193.28:0/2647838508 wait complete. 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 Processor -- start 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 -- start start 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102011d060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1020115270 0x7f102011d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1020122960 0x7f1020122e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1020123370 con 0x7f102010f060 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10201234e0 con 0x7f1020115270 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101ffff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f10201236a0 con 0x7f1020122960 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101effd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102011d060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101effd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102011d060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:32918/0 (socket says 10.20.193.28:32918) 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.300+0000 7f101effd6c0 1 -- 10.20.193.28:0/862650297 learned_addr learned my addr 10.20.193.28:0/862650297 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101effd6c0 1 -- 10.20.193.28:0/862650297 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1020122960 msgr2=0x7f1020122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101effd6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1020122960 0x7f1020122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101effd6c0 1 -- 10.20.193.28:0/862650297 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1020115270 msgr2=0x7f102011d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101effd6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1020115270 0x7f102011d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101effd6c0 1 -- 10.20.193.28:0/862650297 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1014009590 con 0x7f102010f060 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101effd6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102011d060 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1014031fd0 tx=0x7f10140047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1014002ae0 con 0x7f102010f060 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1020163af0 con 0x7f102010f060 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1014007740 con 0x7f102010f060 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1014037660 con 0x7f102010f060 2026-02-13T01:27:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.301+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1020163f70 con 0x7f102010f060 2026-02-13T01:27:59.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.302+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1020110330 con 0x7f102010f060 2026-02-13T01:27:59.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.304+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1014002cc0 con 0x7f102010f060 2026-02-13T01:27:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.305+0000 7f0ffffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.305+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f1014107c40 con 0x7f102010f060 2026-02-13T01:27:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.306+0000 7f101e7fc6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.306+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f10141080c0 con 0x7f102010f060 2026-02-13T01:27:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.306+0000 7f101e7fc6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1008005980 tx=0x7f1008005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:59.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.430+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f102010f430 con 0x7f102010f060 2026-02-13T01:27:59.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.431+0000 7f0ffffff6c0 1 -- 10.20.193.28:0/862650297 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10140ca670 con 0x7f102010f060 2026-02-13T01:27:59.434 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:27:59.434 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:59.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 msgr2=0x7f0ff40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:59.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1008005980 tx=0x7f1008005910 comp rx=0 tx=0).stop 2026-02-13T01:27:59.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 msgr2=0x7f102011d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:59.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102011d060 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1014031fd0 tx=0x7f10140047f0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 shutdown_connections 2026-02-13T01:27:59.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1020122960 0x7f1020122e00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1020115270 0x7f102011d5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/862650297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f102010f060 0x7f102011d060 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:59.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 >> 10.20.193.28:0/862650297 conn(0x7f10200ec980 msgr2=0x7f102010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:59.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 shutdown_connections 2026-02-13T01:27:59.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:27:59.432+0000 7f101ffff6c0 1 -- 10.20.193.28:0/862650297 wait complete. 2026-02-13T01:28:00.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:59 trial134 ceph-mon[27948]: pgmap v274: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:00.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:27:59 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/862650297' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:00.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:59 trial187 ceph-mon[27464]: pgmap v274: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:00.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:27:59 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/862650297' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:00.445 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:59 trial028 ceph-mon[22984]: pgmap v274: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:00.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:27:59 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/862650297' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:02.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:01 trial134 ceph-mon[27948]: pgmap v275: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:02.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:01 trial187 ceph-mon[27464]: pgmap v275: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:02.445 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:01 trial028 ceph-mon[22984]: pgmap v275: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:02.540 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:02.724 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 -- 10.20.193.28:0/1384063081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010fa50 msgr2=0x7f7430114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1384063081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010fa50 0x7f7430114a90 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=17665801082160084761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74180099a0 tx=0x7f741802ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 -- 10.20.193.28:0/1384063081 shutdown_connections 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1384063081 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7430115270 0x7f7430175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1384063081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010fa50 0x7f7430114a90 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=17665801082160084761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1384063081 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f743010f060 0x7f743010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 -- 10.20.193.28:0/1384063081 >> 10.20.193.28:0/1384063081 conn(0x7f74300ec980 msgr2=0x7f743010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.930+0000 7f7434f106c0 1 -- 10.20.193.28:0/1384063081 shutdown_connections 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.931+0000 7f7434f106c0 1 -- 10.20.193.28:0/1384063081 wait complete. 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.931+0000 7f7434f106c0 1 Processor -- start 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.931+0000 7f7434f106c0 1 -- start start 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 0x7f74300f4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:02.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7430115270 0x7f7430175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f74300f50e0 0x7f74300fa360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74300f57d0 con 0x7f743010f060 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74300fa8a0 con 0x7f7430115270 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f74300faa60 con 0x7f74300f50e0 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 0x7f74300f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742dd746c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7430115270 0x7f7430175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 0x7f74300f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:32930/0 (socket says 10.20.193.28:32930) 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 -- 10.20.193.28:0/1457670801 learned_addr learned my addr 10.20.193.28:0/1457670801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742ed766c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f74300f50e0 0x7f74300fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 -- 10.20.193.28:0/1457670801 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f74300f50e0 msgr2=0x7f74300fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f74300f50e0 0x7f74300fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 -- 10.20.193.28:0/1457670801 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7430115270 msgr2=0x7f7430175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7430115270 0x7f7430175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 -- 10.20.193.28:0/1457670801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74240094c0 con 0x7f743010f060 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742dd746c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7430115270 0x7f7430175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f742e5756c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 0x7f74300f4ab0 secure :-1 s=READY pgs=269 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f742400ba30 tx=0x7f742400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74240044a0 con 0x7f743010f060 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7424009030 con 0x7f743010f060 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74240071c0 con 0x7f743010f060 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.932+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7418009590 con 0x7f743010f060 2026-02-13T01:28:02.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.933+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74300fb040 con 0x7f743010f060 2026-02-13T01:28:02.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.933+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7430110330 con 0x7f743010f060 2026-02-13T01:28:02.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.936+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f74240026b0 con 0x7f743010f060 2026-02-13T01:28:02.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.937+0000 7f74177fe6c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f74080b5680 0x7f74080d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:02.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.937+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f74240e3b50 con 0x7f743010f060 2026-02-13T01:28:02.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.938+0000 7f742dd746c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f74080b5680 0x7f74080d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:02.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.938+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f742411c5e0 con 0x7f743010f060 2026-02-13T01:28:02.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:02.938+0000 7f742dd746c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f74080b5680 0x7f74080d5b30 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741802f950 tx=0x7f74180023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:03.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.062+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f743010f430 con 0x7f743010f060 2026-02-13T01:28:03.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.062+0000 7f74177fe6c0 1 -- 10.20.193.28:0/1457670801 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74240a6610 con 0x7f743010f060 2026-02-13T01:28:03.062 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:03.062 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f74080b5680 msgr2=0x7f74080d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f74080b5680 0x7f74080d5b30 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f741802f950 tx=0x7f74180023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 msgr2=0x7f74300f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 0x7f74300f4ab0 secure :-1 s=READY pgs=269 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f742400ba30 tx=0x7f742400bf00 comp rx=0 tx=0).stop 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 shutdown_connections 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f74080b5680 0x7f74080d5b30 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f74300f50e0 0x7f74300fa360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7430115270 0x7f7430175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 --2- 10.20.193.28:0/1457670801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f743010f060 0x7f74300f4ab0 unknown :-1 s=CLOSED pgs=269 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 >> 10.20.193.28:0/1457670801 conn(0x7f74300ec980 msgr2=0x7f743010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 shutdown_connections 2026-02-13T01:28:03.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:03.063+0000 7f7434f106c0 1 -- 10.20.193.28:0/1457670801 wait complete. 2026-02-13T01:28:04.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:03 trial134 ceph-mon[27948]: pgmap v276: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:04.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:03 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1457670801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:04.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:03 trial187 ceph-mon[27464]: pgmap v276: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:04.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:03 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1457670801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:04.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:03 trial028 ceph-mon[22984]: pgmap v276: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:04.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:03 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1457670801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:06.165 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:06.216 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:05 trial028 ceph-mon[22984]: pgmap v277: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:06.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:05 trial134 ceph-mon[27948]: pgmap v277: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:06.349 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:06.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:05 trial187 ceph-mon[27464]: pgmap v277: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2777086575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724115410 msgr2=0x7f1724175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2777086575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724115410 0x7f1724175db0 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=14480322724123401622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172000aa70 tx=0x7f172002fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2777086575 shutdown_connections 2026-02-13T01:28:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2777086575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724115410 0x7f1724175db0 unknown :-1 s=CLOSED pgs=270 gs=2 cs=0 l=1 c_cookie=14480322724123401622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2777086575 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410fbf0 0x7f1724114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2777086575 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f172410f200 0x7f172410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.546+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2777086575 >> 10.20.193.28:0/2777086575 conn(0x7f17240ecb00 msgr2=0x7f172410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.547+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2777086575 shutdown_connections 2026-02-13T01:28:06.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.547+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2777086575 wait complete. 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.547+0000 7f172bcf46c0 1 Processor -- start 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.547+0000 7f172bcf46c0 1 -- start start 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172bcf46c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410f200 0x7f172411d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172bcf46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1724115410 0x7f172411d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172bcf46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724122af0 0x7f1724122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172bcf46c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1724123500 con 0x7f1724122af0 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172bcf46c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1724123670 con 0x7f172410f200 2026-02-13T01:28:06.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172bcf46c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1724123830 con 0x7f1724115410 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f1729a656c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410f200 0x7f172411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f1729a656c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410f200 0x7f172411d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:53090/0 (socket says 10.20.193.28:53090) 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724122af0 0x7f1724122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f1729a656c0 1 -- 10.20.193.28:0/2002091435 learned_addr learned my addr 10.20.193.28:0/2002091435 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f17292646c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1724115410 0x7f172411d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 -- 10.20.193.28:0/2002091435 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1724115410 msgr2=0x7f172411d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1724115410 0x7f172411d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 -- 10.20.193.28:0/2002091435 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410f200 msgr2=0x7f172411d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410f200 0x7f172411d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 -- 10.20.193.28:0/2002091435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172000a660 con 0x7f1724122af0 2026-02-13T01:28:06.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f172a2666c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724122af0 0x7f1724122f90 secure :-1 s=READY pgs=271 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172000aa40 tx=0x7f17200054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.548+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1720003a30 con 0x7f1724122af0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.549+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1720030990 con 0x7f1724122af0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.549+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17200382f0 con 0x7f1724122af0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.549+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1724163c80 con 0x7f1724122af0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.549+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17241640b0 con 0x7f1724122af0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.549+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17241104d0 con 0x7f1724122af0 2026-02-13T01:28:06.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.552+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1720008350 con 0x7f1724122af0 2026-02-13T01:28:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.553+0000 7f1712ffd6c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f17000b5680 0x7f17000d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.553+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f1720108b60 con 0x7f1724122af0 2026-02-13T01:28:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.553+0000 7f1729a656c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f17000b5680 0x7f17000d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.553+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f17201415e0 con 0x7f1724122af0 2026-02-13T01:28:06.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.554+0000 7f1729a656c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f17000b5680 0x7f17000d5b30 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17140095c0 tx=0x7f1714009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:06.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.677+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f172411e340 con 0x7f1724122af0 2026-02-13T01:28:06.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.677+0000 7f1712ffd6c0 1 -- 10.20.193.28:0/2002091435 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f17200cb590 con 0x7f1724122af0 2026-02-13T01:28:06.678 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:06.678 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:06.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.678+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f17000b5680 msgr2=0x7f17000d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:06.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.678+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f17000b5680 0x7f17000d5b30 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17140095c0 tx=0x7f1714009260 comp rx=0 tx=0).stop 2026-02-13T01:28:06.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.678+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724122af0 msgr2=0x7f1724122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:06.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.678+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724122af0 0x7f1724122f90 secure :-1 s=READY pgs=271 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f172000aa40 tx=0x7f17200054b0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 shutdown_connections 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f17000b5680 0x7f17000d5b30 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1724115410 0x7f172411d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1724122af0 0x7f1724122f90 unknown :-1 s=CLOSED pgs=271 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 --2- 10.20.193.28:0/2002091435 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f172410f200 0x7f172411d1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 >> 10.20.193.28:0/2002091435 conn(0x7f17240ecb00 msgr2=0x7f172410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 shutdown_connections 2026-02-13T01:28:06.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:06.679+0000 7f172bcf46c0 1 -- 10.20.193.28:0/2002091435 wait complete. 2026-02-13T01:28:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:06 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2002091435' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:07.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:06 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2002091435' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:07.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:06 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2002091435' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:08.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:07 trial134 ceph-mon[27948]: pgmap v278: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:08.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:07 trial187 ceph-mon[27464]: pgmap v278: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:08.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:07 trial028 ceph-mon[22984]: pgmap v278: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:09.782 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:09.968 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:10.098 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:09 trial028 ceph-mon[22984]: pgmap v279: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/3338800832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d5010f210 msgr2=0x7f9d5010f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/3338800832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d5010f210 0x7f9d5010f5e0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=4691045576960165274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d480099a0 tx=0x7f9d4802ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/3338800832 shutdown_connections 2026-02-13T01:28:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/3338800832 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d5010fc00 0x7f9d50114c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/3338800832 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d50115420 0x7f9d50175dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/3338800832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d5010f210 0x7f9d5010f5e0 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=4691045576960165274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/3338800832 >> 10.20.193.28:0/3338800832 conn(0x7f9d500ecb30 msgr2=0x7f9d5010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/3338800832 shutdown_connections 2026-02-13T01:28:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.169+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/3338800832 wait complete. 2026-02-13T01:28:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 Processor -- start 2026-02-13T01:28:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 -- start start 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d5010f210 0x7f9d5011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d50115420 0x7f9d5011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 0x7f9d50122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50123500 con 0x7f9d50122af0 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50123670 con 0x7f9d5010f210 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d588ab6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50123830 con 0x7f9d50115420 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d5661c6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d5010f210 0x7f9d5011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 0x7f9d50122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 0x7f9d50122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41260/0 (socket says 10.20.193.28:41260) 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 -- 10.20.193.28:0/2831929328 learned_addr learned my addr 10.20.193.28:0/2831929328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d55e1b6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d50115420 0x7f9d5011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 -- 10.20.193.28:0/2831929328 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d50115420 msgr2=0x7f9d5011d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d50115420 0x7f9d5011d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 -- 10.20.193.28:0/2831929328 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d5010f210 msgr2=0x7f9d5011d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d5010f210 0x7f9d5011d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.170+0000 7f9d56e1d6c0 1 -- 10.20.193.28:0/2831929328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d48009590 con 0x7f9d50122af0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d56e1d6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 0x7f9d50122f90 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d44006a60 tx=0x7f9d4400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d44003c40 con 0x7f9d50122af0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9d4400a070 con 0x7f9d50122af0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d4400de20 con 0x7f9d50122af0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d50163ce0 con 0x7f9d50122af0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d50164170 con 0x7f9d50122af0 2026-02-13T01:28:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.171+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d501104e0 con 0x7f9d50122af0 2026-02-13T01:28:10.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.174+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9d44005030 con 0x7f9d50122af0 2026-02-13T01:28:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.175+0000 7f9d3b7fe6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9d2c0b5680 0x7f9d2c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.176+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f9d440e48f0 con 0x7f9d50122af0 2026-02-13T01:28:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.176+0000 7f9d5661c6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9d2c0b5680 0x7f9d2c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.176+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9d440e4d70 con 0x7f9d50122af0 2026-02-13T01:28:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.176+0000 7f9d5661c6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9d2c0b5680 0x7f9d2c0d5b30 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d48005b40 tx=0x7f9d480023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.300+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d5010f5e0 con 0x7f9d50122af0 2026-02-13T01:28:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.300+0000 7f9d3b7fe6c0 1 -- 10.20.193.28:0/2831929328 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9d440a7320 con 0x7f9d50122af0 2026-02-13T01:28:10.301 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:10.301 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9d2c0b5680 msgr2=0x7f9d2c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9d2c0b5680 0x7f9d2c0d5b30 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d48005b40 tx=0x7f9d480023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 msgr2=0x7f9d50122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 0x7f9d50122f90 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d44006a60 tx=0x7f9d4400cca0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 shutdown_connections 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f9d2c0b5680 0x7f9d2c0d5b30 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9d50115420 0x7f9d5011d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d50122af0 0x7f9d50122f90 unknown :-1 s=CLOSED pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 --2- 10.20.193.28:0/2831929328 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9d5010f210 0x7f9d5011d1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:10.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 >> 10.20.193.28:0/2831929328 conn(0x7f9d500ecb30 msgr2=0x7f9d5010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:10.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 shutdown_connections 2026-02-13T01:28:10.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:10.301+0000 7f9d588ab6c0 1 -- 10.20.193.28:0/2831929328 wait complete. 2026-02-13T01:28:10.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:09 trial134 ceph-mon[27948]: pgmap v279: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:10.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:09 trial187 ceph-mon[27464]: pgmap v279: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:11.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:10 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2831929328' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:11.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:10 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2831929328' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:11.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:10 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2831929328' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:12.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:11 trial134 ceph-mon[27948]: pgmap v280: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:12.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:11 trial187 ceph-mon[27464]: pgmap v280: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:12.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:11 trial028 ceph-mon[22984]: pgmap v280: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:13.408 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:13.593 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:13.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 -- 10.20.193.28:0/1808894625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c10fa50 msgr2=0x7fe76c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:13.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1808894625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c10fa50 0x7fe76c114a90 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=1602525462064552037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7540099a0 tx=0x7fe75402ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:13.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 -- 10.20.193.28:0/1808894625 shutdown_connections 2026-02-13T01:28:13.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1808894625 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe76c115270 0x7fe76c175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1808894625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c10fa50 0x7fe76c114a90 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=1602525462064552037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1808894625 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.779+0000 7fe7709326c0 1 -- 10.20.193.28:0/1808894625 >> 10.20.193.28:0/1808894625 conn(0x7fe76c0ec980 msgr2=0x7fe76c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:13.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.780+0000 7fe7709326c0 1 -- 10.20.193.28:0/1808894625 shutdown_connections 2026-02-13T01:28:13.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.780+0000 7fe7709326c0 1 -- 10.20.193.28:0/1808894625 wait complete. 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.780+0000 7fe7709326c0 1 Processor -- start 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.780+0000 7fe7709326c0 1 -- start start 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe7709326c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c0f4a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe7709326c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe76c115270 0x7fe76c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe7709326c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c0f5040 0x7fe76c0fa310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe7709326c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0f5730 con 0x7fe76c0f5040 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe7709326c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0fa850 con 0x7fe76c10f060 2026-02-13T01:28:13.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe7709326c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0faa10 con 0x7fe76c115270 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c0f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76a5756c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe76c115270 0x7fe76c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c0f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:53124/0 (socket says 10.20.193.28:53124) 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 -- 10.20.193.28:0/1301179614 learned_addr learned my addr 10.20.193.28:0/1301179614 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76b5776c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c0f5040 0x7fe76c0fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 -- 10.20.193.28:0/1301179614 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe76c115270 msgr2=0x7fe76c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe76c115270 0x7fe76c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 -- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c0f5040 msgr2=0x7fe76c0fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c0f5040 0x7fe76c0fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 -- 10.20.193.28:0/1301179614 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe754009590 con 0x7fe76c10f060 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76b5776c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c0f5040 0x7fe76c0fa310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:13.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.781+0000 7fe76ad766c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c0f4a10 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76000b740 tx=0x7fe76000bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.782+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe760004250 con 0x7fe76c10f060 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.782+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe760009070 con 0x7fe76c10f060 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.782+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76c0facf0 con 0x7fe76c10f060 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.782+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe76000ce10 con 0x7fe76c10f060 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.782+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76c0fb480 con 0x7fe76c10f060 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.782+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76c110330 con 0x7fe76c10f060 2026-02-13T01:28:13.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.785+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fe7600028c0 con 0x7fe76c10f060 2026-02-13T01:28:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.786+0000 7fe74bfff6c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe7400b5600 0x7fe7400d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.787+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fe7600e39d0 con 0x7fe76c10f060 2026-02-13T01:28:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.787+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe7600e3e50 con 0x7fe76c10f060 2026-02-13T01:28:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.787+0000 7fe76a5756c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe7400b5600 0x7fe7400d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:13.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.787+0000 7fe76a5756c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe7400b5600 0x7fe7400d5ab0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76c0fb3a0 tx=0x7fe7540023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:13.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.910+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe76c0f5b60 con 0x7fe76c10f060 2026-02-13T01:28:13.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.911+0000 7fe74bfff6c0 1 -- 10.20.193.28:0/1301179614 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe7600a6400 con 0x7fe76c10f060 2026-02-13T01:28:13.911 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:13.912 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe7400b5600 msgr2=0x7fe7400d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe7400b5600 0x7fe7400d5ab0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76c0fb3a0 tx=0x7fe7540023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 msgr2=0x7fe76c0f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c0f4a10 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76000b740 tx=0x7fe76000bc10 comp rx=0 tx=0).stop 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 shutdown_connections 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe7400b5600 0x7fe7400d5ab0 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe76c115270 0x7fe76c175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76c0f5040 0x7fe76c0fa310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 --2- 10.20.193.28:0/1301179614 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe76c10f060 0x7fe76c0f4a10 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 >> 10.20.193.28:0/1301179614 conn(0x7fe76c0ec980 msgr2=0x7fe76c10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 shutdown_connections 2026-02-13T01:28:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:13.912+0000 7fe7709326c0 1 -- 10.20.193.28:0/1301179614 wait complete. 2026-02-13T01:28:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:13 trial134 ceph-mon[27948]: pgmap v281: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:14.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:13 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1301179614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:14.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:13 trial187 ceph-mon[27464]: pgmap v281: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:14.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:13 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1301179614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:14.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:13 trial028 ceph-mon[22984]: pgmap v281: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:14.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:13 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1301179614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:16.249 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:15 trial028 ceph-mon[22984]: pgmap v282: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:16.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:15 trial134 ceph-mon[27948]: pgmap v282: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:16.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:15 trial187 ceph-mon[27464]: pgmap v282: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:17.019 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:17.205 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 -- 10.20.193.28:0/2383246894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e411b510 msgr2=0x7f02e411b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 --2- 10.20.193.28:0/2383246894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e411b510 0x7f02e411b8e0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=6666379269483793764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02d8009970 tx=0x7f02d802ed10 comp rx=0 tx=0).stop 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 -- 10.20.193.28:0/2383246894 shutdown_connections 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 --2- 10.20.193.28:0/2383246894 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f02e4113dc0 0x7f02e4114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 --2- 10.20.193.28:0/2383246894 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e41149c0 0x7f02e4114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 --2- 10.20.193.28:0/2383246894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e411b510 0x7f02e411b8e0 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=6666379269483793764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 -- 10.20.193.28:0/2383246894 >> 10.20.193.28:0/2383246894 conn(0x7f02e4058a50 msgr2=0x7f02e4058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:17.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 -- 10.20.193.28:0/2383246894 shutdown_connections 2026-02-13T01:28:17.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.405+0000 7f02e91386c0 1 -- 10.20.193.28:0/2383246894 wait complete. 2026-02-13T01:28:17.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 Processor -- start 2026-02-13T01:28:17.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 -- start start 2026-02-13T01:28:17.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e4113dc0 0x7f02e412b840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:17.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 0x7f02e412bd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:17.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f02e411b510 0x7f02e4131140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:17.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4131790 con 0x7f02e41149c0 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4131900 con 0x7f02e4113dc0 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e91386c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4131ac0 con 0x7f02e411b510 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e2d766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e4113dc0 0x7f02e412b840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e25756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 0x7f02e412bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e25756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 0x7f02e412bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34012/0 (socket says 10.20.193.28:34012) 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.406+0000 7f02e25756c0 1 -- 10.20.193.28:0/1455028122 learned_addr learned my addr 10.20.193.28:0/1455028122 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e35776c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f02e411b510 0x7f02e4131140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e25756c0 1 -- 10.20.193.28:0/1455028122 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f02e411b510 msgr2=0x7f02e4131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e25756c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f02e411b510 0x7f02e4131140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e25756c0 1 -- 10.20.193.28:0/1455028122 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e4113dc0 msgr2=0x7f02e412b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:17.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e25756c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e4113dc0 0x7f02e412b840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e25756c0 1 -- 10.20.193.28:0/1455028122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d8009590 con 0x7f02e41149c0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e2d766c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e4113dc0 0x7f02e412b840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e25756c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 0x7f02e412bd80 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02cc009490 tx=0x7f02cc00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02cc004a80 con 0x7f02e41149c0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f02cc009030 con 0x7f02e41149c0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02cc00ce50 con 0x7f02e41149c0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e4131da0 con 0x7f02e41149c0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.407+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e4172480 con 0x7f02e41149c0 2026-02-13T01:28:17.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.408+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e4131fc0 con 0x7f02e41149c0 2026-02-13T01:28:17.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.410+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f02cc004ce0 con 0x7f02e41149c0 2026-02-13T01:28:17.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.411+0000 7f02c3fff6c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f02b80b5680 0x7f02b80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:17.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.412+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f02cc0e3bb0 con 0x7f02e41149c0 2026-02-13T01:28:17.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.412+0000 7f02e2d766c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f02b80b5680 0x7f02b80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:17.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.412+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f02cc11c620 con 0x7f02e41149c0 2026-02-13T01:28:17.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.412+0000 7f02e2d766c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f02b80b5680 0x7f02b80d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02d80023e0 tx=0x7f02d802f5b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.537+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f02e405b000 con 0x7f02e41149c0 2026-02-13T01:28:17.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.537+0000 7f02c3fff6c0 1 -- 10.20.193.28:0/1455028122 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f02cc0a65e0 con 0x7f02e41149c0 2026-02-13T01:28:17.537 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:17.537 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f02b80b5680 msgr2=0x7f02b80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f02b80b5680 0x7f02b80d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02d80023e0 tx=0x7f02d802f5b0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 msgr2=0x7f02e412bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:17.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 0x7f02e412bd80 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02cc009490 tx=0x7f02cc00bc50 comp rx=0 tx=0).stop 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 shutdown_connections 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f02b80b5680 0x7f02b80d5b30 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f02e411b510 0x7f02e4131140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02e41149c0 0x7f02e412bd80 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 --2- 10.20.193.28:0/1455028122 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f02e4113dc0 0x7f02e412b840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 >> 10.20.193.28:0/1455028122 conn(0x7f02e4058a50 msgr2=0x7f02e411a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 shutdown_connections 2026-02-13T01:28:17.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:17.538+0000 7f02e91386c0 1 -- 10.20.193.28:0/1455028122 wait complete. 2026-02-13T01:28:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:17 trial134 ceph-mon[27948]: pgmap v283: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:18.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:17 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1455028122' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:18.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:17 trial187 ceph-mon[27464]: pgmap v283: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:18.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:17 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1455028122' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:18.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:17 trial028 ceph-mon[22984]: pgmap v283: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:18.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:17 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1455028122' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:20.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:19 trial134 ceph-mon[27948]: pgmap v284: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:20.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:19 trial187 ceph-mon[27464]: pgmap v284: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:20.445 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:19 trial028 ceph-mon[22984]: pgmap v284: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:20.643 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:20.827 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 -- 10.20.193.28:0/4095755150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010fbf0 msgr2=0x7fadb0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/4095755150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010fbf0 0x7fadb0114c30 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=4654088221599504289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fada40099a0 tx=0x7fada402ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 -- 10.20.193.28:0/4095755150 shutdown_connections 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/4095755150 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fadb0115410 0x7fadb0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/4095755150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010fbf0 0x7fadb0114c30 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=4654088221599504289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/4095755150 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fadb010f200 0x7fadb010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 -- 10.20.193.28:0/4095755150 >> 10.20.193.28:0/4095755150 conn(0x7fadb00ecb00 msgr2=0x7fadb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 -- 10.20.193.28:0/4095755150 shutdown_connections 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 -- 10.20.193.28:0/4095755150 wait complete. 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.025+0000 7fadb769b6c0 1 Processor -- start 2026-02-13T01:28:21.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 -- start start 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 0x7fadb00f4b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fadb0115410 0x7fadb0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fadb00f5160 0x7fadb00fa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00f57c0 con 0x7fadb010f200 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00fa970 con 0x7fadb00f5160 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb769b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00fab30 con 0x7fadb0115410 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 0x7fadb00f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 0x7fadb00f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34030/0 (socket says 10.20.193.28:34030) 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 -- 10.20.193.28:0/1032726348 learned_addr learned my addr 10.20.193.28:0/1032726348 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb4c0b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fadb0115410 0x7fadb0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb5c0d6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fadb00f5160 0x7fadb00fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 -- 10.20.193.28:0/1032726348 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fadb0115410 msgr2=0x7fadb0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fadb0115410 0x7fadb0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 -- 10.20.193.28:0/1032726348 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fadb00f5160 msgr2=0x7fadb00fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fadb00f5160 0x7fadb00fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 -- 10.20.193.28:0/1032726348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4009590 con 0x7fadb010f200 2026-02-13T01:28:21.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.026+0000 7fadb540c6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 0x7fadb00f4b30 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fada0009490 tx=0x7fada000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:21.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.027+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fada0004a80 con 0x7fadb010f200 2026-02-13T01:28:21.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.027+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fada0009030 con 0x7fadb010f200 2026-02-13T01:28:21.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.027+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fada000ce50 con 0x7fadb010f200 2026-02-13T01:28:21.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.027+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb00fadb0 con 0x7fadb010f200 2026-02-13T01:28:21.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.027+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb00fb240 con 0x7fadb010f200 2026-02-13T01:28:21.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.027+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb01104d0 con 0x7fadb010f200 2026-02-13T01:28:21.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.030+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fada0004ce0 con 0x7fadb010f200 2026-02-13T01:28:21.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.031+0000 7fad9e7fc6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad8c0b5680 0x7fad8c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.031+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fada00e3b50 con 0x7fadb010f200 2026-02-13T01:28:21.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.031+0000 7fadb4c0b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad8c0b5680 0x7fad8c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:21.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.031+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fada011c620 con 0x7fadb010f200 2026-02-13T01:28:21.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.032+0000 7fadb4c0b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad8c0b5680 0x7fad8c0d5b30 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fada40023e0 tx=0x7fada4005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:21.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.157+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fadb010f5d0 con 0x7fadb010f200 2026-02-13T01:28:21.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.158+0000 7fad9e7fc6c0 1 -- 10.20.193.28:0/1032726348 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fada00a65c0 con 0x7fadb010f200 2026-02-13T01:28:21.158 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:21.158 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad8c0b5680 msgr2=0x7fad8c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad8c0b5680 0x7fad8c0d5b30 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fada40023e0 tx=0x7fada4005c80 comp rx=0 tx=0).stop 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 msgr2=0x7fadb00f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 0x7fadb00f4b30 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fada0009490 tx=0x7fada000bc50 comp rx=0 tx=0).stop 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 shutdown_connections 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fad8c0b5680 0x7fad8c0d5b30 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fadb0115410 0x7fadb0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fadb00f5160 0x7fadb00fa430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 --2- 10.20.193.28:0/1032726348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fadb010f200 0x7fadb00f4b30 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 >> 10.20.193.28:0/1032726348 conn(0x7fadb00ecb00 msgr2=0x7fadb010d800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 shutdown_connections 2026-02-13T01:28:21.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:21.159+0000 7fadb769b6c0 1 -- 10.20.193.28:0/1032726348 wait complete. 2026-02-13T01:28:22.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:21 trial134 ceph-mon[27948]: pgmap v285: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:22.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:21 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1032726348' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:22.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:21 trial187 ceph-mon[27464]: pgmap v285: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:22.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:21 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1032726348' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:22.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:21 trial028 ceph-mon[22984]: pgmap v285: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:22.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:21 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1032726348' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:24.296 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:24.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:23 trial134 ceph-mon[27948]: pgmap v286: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:24.348 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:23 trial028 ceph-mon[22984]: pgmap v286: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:24.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:23 trial187 ceph-mon[27464]: pgmap v286: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:24.482 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/40268938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44115270 msgr2=0x7faa44175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/40268938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44115270 0x7faa44175c10 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=11980797371675641456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa4000aa70 tx=0x7faa4002fe00 comp rx=0 tx=0).stop 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/40268938 shutdown_connections 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/40268938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44115270 0x7faa44175c10 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=11980797371675641456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/40268938 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410fa50 0x7faa44114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/40268938 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa4410f060 0x7faa4410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/40268938 >> 10.20.193.28:0/40268938 conn(0x7faa440ec980 msgr2=0x7faa4410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:24.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/40268938 shutdown_connections 2026-02-13T01:28:24.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.690+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/40268938 wait complete. 2026-02-13T01:28:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.691+0000 7faa4a9f26c0 1 Processor -- start 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.691+0000 7faa4a9f26c0 1 -- start start 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.691+0000 7faa4a9f26c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 0x7faa4411cf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.691+0000 7faa4a9f26c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa44115270 0x7faa4411d490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa4a9f26c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44122850 0x7faa44122cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa4a9f26c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa44123260 con 0x7faa44122850 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa4a9f26c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa441233d0 con 0x7faa4410f060 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa4a9f26c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa44123590 con 0x7faa44115270 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 0x7faa4411cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:24.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa491ef6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa44115270 0x7faa4411d490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa491ef6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa44115270 0x7faa4411d490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:45000/0 (socket says 10.20.193.28:45000) 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa491ef6c0 1 -- 10.20.193.28:0/122141978 learned_addr learned my addr 10.20.193.28:0/122141978 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 0x7faa4411cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:51638/0 (socket says 10.20.193.28:51638) 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa4a1f16c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44122850 0x7faa44122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 -- 10.20.193.28:0/122141978 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa44115270 msgr2=0x7faa4411d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa44115270 0x7faa4411d490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 -- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44122850 msgr2=0x7faa44122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44122850 0x7faa44122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 -- 10.20.193.28:0/122141978 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4000a660 con 0x7faa4410f060 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.692+0000 7faa499f06c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 0x7faa4411cf50 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3400b6c0 tx=0x7faa3400bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.693+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa34004240 con 0x7faa4410f060 2026-02-13T01:28:24.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.693+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faa34009030 con 0x7faa4410f060 2026-02-13T01:28:24.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.693+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa340036e0 con 0x7faa4410f060 2026-02-13T01:28:24.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.693+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa44163a40 con 0x7faa4410f060 2026-02-13T01:28:24.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.693+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa44163ea0 con 0x7faa4410f060 2026-02-13T01:28:24.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.693+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa44110330 con 0x7faa4410f060 2026-02-13T01:28:24.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.696+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7faa34003880 con 0x7faa4410f060 2026-02-13T01:28:24.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.698+0000 7faa3affd6c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa180b5680 0x7faa180d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:24.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.698+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7faa340e3950 con 0x7faa4410f060 2026-02-13T01:28:24.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.698+0000 7faa491ef6c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa180b5680 0x7faa180d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:24.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.698+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faa340e3dd0 con 0x7faa4410f060 2026-02-13T01:28:24.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.698+0000 7faa491ef6c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa180b5680 0x7faa180d5b30 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa441238e0 tx=0x7faa30009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:24.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.823+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa4410f430 con 0x7faa4410f060 2026-02-13T01:28:24.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.823+0000 7faa3affd6c0 1 -- 10.20.193.28:0/122141978 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faa340a6380 con 0x7faa4410f060 2026-02-13T01:28:24.823 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:24.824 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:24.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa180b5680 msgr2=0x7faa180d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa180b5680 0x7faa180d5b30 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa441238e0 tx=0x7faa30009260 comp rx=0 tx=0).stop 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 msgr2=0x7faa4411cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 0x7faa4411cf50 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa3400b6c0 tx=0x7faa3400bb90 comp rx=0 tx=0).stop 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 shutdown_connections 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7faa180b5680 0x7faa180d5b30 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7faa44115270 0x7faa4411d490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa44122850 0x7faa44122cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 --2- 10.20.193.28:0/122141978 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7faa4410f060 0x7faa4411cf50 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 >> 10.20.193.28:0/122141978 conn(0x7faa440ec980 msgr2=0x7faa4410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:24.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 shutdown_connections 2026-02-13T01:28:24.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:24.824+0000 7faa4a9f26c0 1 -- 10.20.193.28:0/122141978 wait complete. 2026-02-13T01:28:25.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/122141978' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/122141978' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:25.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/122141978' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:26.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:25 trial134 ceph-mon[27948]: pgmap v287: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:26.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:25 trial187 ceph-mon[27464]: pgmap v287: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:26.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:25 trial028 ceph-mon[22984]: pgmap v287: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:27.927 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:28.109 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:28.240 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:27 trial028 ceph-mon[22984]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:28.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 -- 10.20.193.28:0/1229922026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340116520 msgr2=0x7f934017a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 --2- 10.20.193.28:0/1229922026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340116520 0x7f934017a100 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=17971089501762218197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f933400aa70 tx=0x7f933402fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 -- 10.20.193.28:0/1229922026 shutdown_connections 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 --2- 10.20.193.28:0/1229922026 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9340114190 0x7f9340115d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 --2- 10.20.193.28:0/1229922026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340116520 0x7f934017a100 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=17971089501762218197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 --2- 10.20.193.28:0/1229922026 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f93401137a0 0x7f9340113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 -- 10.20.193.28:0/1229922026 >> 10.20.193.28:0/1229922026 conn(0x7f9340061510 msgr2=0x7f9340061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 -- 10.20.193.28:0/1229922026 shutdown_connections 2026-02-13T01:28:28.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.294+0000 7f93453776c0 1 -- 10.20.193.28:0/1229922026 wait complete. 2026-02-13T01:28:28.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 Processor -- start 2026-02-13T01:28:28.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 -- start start 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f93401137a0 0x7f9340121480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9340116520 0x7f93401219c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340126d80 0x7f9340127220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9340127790 con 0x7f9340126d80 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9340127900 con 0x7f9340116520 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.295+0000 7f93453776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9340127ac0 con 0x7f93401137a0 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933ffff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f93401137a0 0x7f9340121480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933ffff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f93401137a0 0x7f9340121480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:41546/0 (socket says 10.20.193.28:41546) 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933ffff6c0 1 -- 10.20.193.28:0/2045416815 learned_addr learned my addr 10.20.193.28:0/2045416815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340126d80 0x7f9340127220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933f7fe6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9340116520 0x7f93401219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 -- 10.20.193.28:0/2045416815 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f93401137a0 msgr2=0x7f9340121480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f93401137a0 0x7f9340121480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 -- 10.20.193.28:0/2045416815 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9340116520 msgr2=0x7f93401219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9340116520 0x7f93401219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 -- 10.20.193.28:0/2045416815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933400a660 con 0x7f9340126d80 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f9344b766c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340126d80 0x7f9340127220 secure :-1 s=READY pgs=281 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f933400aa40 tx=0x7f93340054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9334003a30 con 0x7f9340126d80 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9334003b90 con 0x7f9340126d80 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.296+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93340382f0 con 0x7f9340126d80 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.297+0000 7f93453776c0 1 -- 10.20.193.28:0/2045416815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9340167f10 con 0x7f9340126d80 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.297+0000 7f93453776c0 1 -- 10.20.193.28:0/2045416815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9340168310 con 0x7f9340126d80 2026-02-13T01:28:28.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.297+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9340114840 con 0x7f9340126d80 2026-02-13T01:28:28.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.299+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9334003d00 con 0x7f9340126d80 2026-02-13T01:28:28.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.301+0000 7f933d7fa6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93140b5750 0x7f93140d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.301+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f9334108f10 con 0x7f9340126d80 2026-02-13T01:28:28.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.301+0000 7f933ffff6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93140b5750 0x7f93140d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:27 trial134 ceph-mon[27948]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:28.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.301+0000 7f933ffff6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93140b5750 0x7f93140d5c00 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f932c005c80 tx=0x7f932c0094c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:28.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.301+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f93340cb940 con 0x7f9340126d80 2026-02-13T01:28:28.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:27 trial187 ceph-mon[27464]: pgmap v288: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.426+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9340113b70 con 0x7f9340126d80 2026-02-13T01:28:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.427+0000 7f933d7fa6c0 1 -- 10.20.193.28:0/2045416815 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f93340ceaf0 con 0x7f9340126d80 2026-02-13T01:28:28.427 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:28.427 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:28.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93140b5750 msgr2=0x7f93140d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93140b5750 0x7f93140d5c00 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f932c005c80 tx=0x7f932c0094c0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340126d80 msgr2=0x7f9340127220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340126d80 0x7f9340127220 secure :-1 s=READY pgs=281 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f933400aa40 tx=0x7f93340054b0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 shutdown_connections 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9340126d80 0x7f9340127220 unknown :-1 s=CLOSED pgs=281 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f9340116520 0x7f93401219c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f93140b5750 0x7f93140d5c00 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 --2- 10.20.193.28:0/2045416815 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f93401137a0 0x7f9340121480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 >> 10.20.193.28:0/2045416815 conn(0x7f9340061510 msgr2=0x7f9340116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:28.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 shutdown_connections 2026-02-13T01:28:28.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:28.428+0000 7f9312ffd6c0 1 -- 10.20.193.28:0/2045416815 wait complete. 2026-02-13T01:28:29.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:29 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2045416815' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:29.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:29 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2045416815' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:29.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:28 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2045416815' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:30.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:30 trial134 ceph-mon[27948]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:30.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:30 trial187 ceph-mon[27464]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:30.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:30 trial028 ceph-mon[22984]: pgmap v289: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:31.530 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:31.714 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3080264479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe49410f060 msgr2=0x7fe49410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3080264479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe49410f060 0x7fe49410f430 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=3235535126856379239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4880099a0 tx=0x7fe48802ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3080264479 shutdown_connections 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3080264479 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe494115270 0x7fe494175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3080264479 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe49410fa50 0x7fe494114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3080264479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe49410f060 0x7fe49410f430 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=3235535126856379239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3080264479 >> 10.20.193.28:0/3080264479 conn(0x7fe4940ec980 msgr2=0x7fe49410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3080264479 shutdown_connections 2026-02-13T01:28:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.897+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3080264479 wait complete. 2026-02-13T01:28:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 Processor -- start 2026-02-13T01:28:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 -- start start 2026-02-13T01:28:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 0x7fe49411cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe494115270 0x7fe49411d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe494122830 0x7fe494122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe494123240 con 0x7fe494115270 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941233b0 con 0x7fe494122830 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe493fff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe494123570 con 0x7fe49410f060 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe492ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 0x7fe49411cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe492ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 0x7fe49411cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:41570/0 (socket says 10.20.193.28:41570) 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe492ffd6c0 1 -- 10.20.193.28:0/3890110599 learned_addr learned my addr 10.20.193.28:0/3890110599 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe4937fe6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe494122830 0x7fe494122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.898+0000 7fe4927fc6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe494115270 0x7fe49411d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe492ffd6c0 1 -- 10.20.193.28:0/3890110599 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe494122830 msgr2=0x7fe494122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe492ffd6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe494122830 0x7fe494122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe492ffd6c0 1 -- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe494115270 msgr2=0x7fe49411d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe492ffd6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe494115270 0x7fe49411d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe492ffd6c0 1 -- 10.20.193.28:0/3890110599 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe488009590 con 0x7fe49410f060 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe4927fc6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe494115270 0x7fe49411d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe492ffd6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 0x7fe49411cf30 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe488031fd0 tx=0x7fe48802fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe488002ae0 con 0x7fe49410f060 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe488002c40 con 0x7fe49410f060 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4880372f0 con 0x7fe49410f060 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4941639c0 con 0x7fe49410f060 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.899+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe494163df0 con 0x7fe49410f060 2026-02-13T01:28:31.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.900+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe494110330 con 0x7fe49410f060 2026-02-13T01:28:31.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.902+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fe488007260 con 0x7fe49410f060 2026-02-13T01:28:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.904+0000 7fe473fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe4680b5600 0x7fe4680d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.904+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fe488107d00 con 0x7fe49410f060 2026-02-13T01:28:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.904+0000 7fe4927fc6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe4680b5600 0x7fe4680d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.904+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe488108180 con 0x7fe49410f060 2026-02-13T01:28:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:31.905+0000 7fe4927fc6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe4680b5600 0x7fe4680d5ab0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4941238c0 tx=0x7fe47c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:32.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.027+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe49410f430 con 0x7fe49410f060 2026-02-13T01:28:32.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.028+0000 7fe473fff6c0 1 -- 10.20.193.28:0/3890110599 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe4880ca730 con 0x7fe49410f060 2026-02-13T01:28:32.028 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:32.028 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:32.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe4680b5600 msgr2=0x7fe4680d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe4680b5600 0x7fe4680d5ab0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4941238c0 tx=0x7fe47c009390 comp rx=0 tx=0).stop 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 msgr2=0x7fe49411cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 0x7fe49411cf30 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe488031fd0 tx=0x7fe48802fc60 comp rx=0 tx=0).stop 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 shutdown_connections 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe494122830 0x7fe494122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe494115270 0x7fe49411d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe4680b5600 0x7fe4680d5ab0 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 --2- 10.20.193.28:0/3890110599 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe49410f060 0x7fe49411cf30 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 >> 10.20.193.28:0/3890110599 conn(0x7fe4940ec980 msgr2=0x7fe49410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:32.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 shutdown_connections 2026-02-13T01:28:32.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:32.029+0000 7fe493fff6c0 1 -- 10.20.193.28:0/3890110599 wait complete. 2026-02-13T01:28:32.105 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:32 trial028 ceph-mon[22984]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:32.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:32 trial134 ceph-mon[27948]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:32.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:32 trial187 ceph-mon[27464]: pgmap v290: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:33.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:33 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3890110599' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:33.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:33 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3890110599' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:33.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:33 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3890110599' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:34.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:34 trial134 ceph-mon[27948]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:34.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:34 trial187 ceph-mon[27464]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:34.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:34 trial028 ceph-mon[22984]: pgmap v291: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:35.132 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:35.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:35 trial134 ceph-mon[27948]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:35.317 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:35.362 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:35 trial028 ceph-mon[22984]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:35.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:35 trial187 ceph-mon[27464]: pgmap v292: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:28:35.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/3034968646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df410fa50 msgr2=0x7f1df4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 --2- 10.20.193.28:0/3034968646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df410fa50 0x7f1df4114a90 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=5378823264291609571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de80099a0 tx=0x7f1de802ed50 comp rx=0 tx=0).stop 2026-02-13T01:28:35.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/3034968646 shutdown_connections 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 --2- 10.20.193.28:0/3034968646 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1df4115270 0x7f1df4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 --2- 10.20.193.28:0/3034968646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df410fa50 0x7f1df4114a90 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=5378823264291609571 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 --2- 10.20.193.28:0/3034968646 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1df410f060 0x7f1df410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/3034968646 >> 10.20.193.28:0/3034968646 conn(0x7f1df40ec980 msgr2=0x7f1df410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/3034968646 shutdown_connections 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/3034968646 wait complete. 2026-02-13T01:28:35.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.525+0000 7f1dfa4b76c0 1 Processor -- start 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 -- start start 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1df410f060 0x7f1df40f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 0x7f1df4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1df40f4fc0 0x7f1df40fa290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1df40f56b0 con 0x7f1df4115270 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1df40fa7d0 con 0x7f1df40f4fc0 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1dfa4b76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1df40fa990 con 0x7f1df410f060 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 0x7f1df4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df94b56c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1df410f060 0x7f1df40f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 0x7f1df4175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47468/0 (socket says 10.20.193.28:47468) 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 -- 10.20.193.28:0/598232926 learned_addr learned my addr 10.20.193.28:0/598232926 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df9cb66c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1df40f4fc0 0x7f1df40fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 -- 10.20.193.28:0/598232926 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1df410f060 msgr2=0x7f1df40f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1df410f060 0x7f1df40f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 -- 10.20.193.28:0/598232926 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1df40f4fc0 msgr2=0x7f1df40fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1df40f4fc0 0x7f1df40fa290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 -- 10.20.193.28:0/598232926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de8009590 con 0x7f1df4115270 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.526+0000 7f1df8cb46c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 0x7f1df4175b10 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de802f260 tx=0x7f1de802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.527+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1de8002ae0 con 0x7f1df4115270 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.527+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1de80046b0 con 0x7f1df4115270 2026-02-13T01:28:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.527+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1de8031030 con 0x7f1df4115270 2026-02-13T01:28:35.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.527+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/598232926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df40fac10 con 0x7f1df4115270 2026-02-13T01:28:35.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.527+0000 7f1dfa4b76c0 1 -- 10.20.193.28:0/598232926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df40fb0e0 con 0x7f1df4115270 2026-02-13T01:28:35.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.527+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df4110330 con 0x7f1df4115270 2026-02-13T01:28:35.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.530+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1de8007260 con 0x7f1df4115270 2026-02-13T01:28:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.532+0000 7f1de27fc6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1dd00b5680 0x7f1dd00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.532+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f1de8107980 con 0x7f1df4115270 2026-02-13T01:28:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.532+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1de8107e00 con 0x7f1df4115270 2026-02-13T01:28:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.532+0000 7f1df94b56c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1dd00b5680 0x7f1dd00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.533+0000 7f1df94b56c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1dd00b5680 0x7f1dd00d5b30 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de4004750 tx=0x7f1de4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:35.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.656+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1df40f5ae0 con 0x7f1df4115270 2026-02-13T01:28:35.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.656+0000 7f1de27fc6c0 1 -- 10.20.193.28:0/598232926 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1de80ca3b0 con 0x7f1df4115270 2026-02-13T01:28:35.656 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:35.657 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:35.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1dd00b5680 msgr2=0x7f1dd00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1dd00b5680 0x7f1dd00d5b30 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de4004750 tx=0x7f1de4009260 comp rx=0 tx=0).stop 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 msgr2=0x7f1df4175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 0x7f1df4175b10 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de802f260 tx=0x7f1de802fbf0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 shutdown_connections 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1df40f4fc0 0x7f1df40fa290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df4115270 0x7f1df4175b10 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1dd00b5680 0x7f1dd00d5b30 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 --2- 10.20.193.28:0/598232926 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1df410f060 0x7f1df40f4990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 >> 10.20.193.28:0/598232926 conn(0x7f1df40ec980 msgr2=0x7f1df41138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 shutdown_connections 2026-02-13T01:28:35.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:35.657+0000 7f1dc3fff6c0 1 -- 10.20.193.28:0/598232926 wait complete. 2026-02-13T01:28:36.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:36 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/598232926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:36.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:36 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/598232926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:36.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:36 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/598232926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:37.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:37 trial134 ceph-mon[27948]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:37.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:37 trial187 ceph-mon[27464]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:37.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:37 trial028 ceph-mon[22984]: pgmap v293: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:28:38.759 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:38.945 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 -- 10.20.193.28:0/4033175716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c115410 msgr2=0x7f615c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 --2- 10.20.193.28:0/4033175716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c115410 0x7f615c175db0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=2449014286349716470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f615000aa70 tx=0x7f615002fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 -- 10.20.193.28:0/4033175716 shutdown_connections 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 --2- 10.20.193.28:0/4033175716 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615c10fbf0 0x7f615c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 --2- 10.20.193.28:0/4033175716 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c115410 0x7f615c175db0 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=2449014286349716470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 --2- 10.20.193.28:0/4033175716 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 0x7f615c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 -- 10.20.193.28:0/4033175716 >> 10.20.193.28:0/4033175716 conn(0x7f615c0ecb00 msgr2=0x7f615c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.151+0000 7f6161be36c0 1 -- 10.20.193.28:0/4033175716 shutdown_connections 2026-02-13T01:28:39.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.152+0000 7f6161be36c0 1 -- 10.20.193.28:0/4033175716 wait complete. 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.152+0000 7f6161be36c0 1 Processor -- start 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.152+0000 7f6161be36c0 1 -- start start 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f6161be36c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 0x7f615c11d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f6161be36c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615c115410 0x7f615c11d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f6161be36c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 0x7f615c122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f6161be36c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f615c123480 con 0x7f615c122a70 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f6161be36c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f615c1235f0 con 0x7f615c10f200 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f6161be36c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f615c1237b0 con 0x7f615c115410 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f615bfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 0x7f615c122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:39.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f615bfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 0x7f615c122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37532/0 (socket says 10.20.193.28:37532) 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f615bfff6c0 1 -- 10.20.193.28:0/2770468573 learned_addr learned my addr 10.20.193.28:0/2770468573 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f615b7fe6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 0x7f615c11d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.153+0000 7f615affd6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615c115410 0x7f615c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615bfff6c0 1 -- 10.20.193.28:0/2770468573 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615c115410 msgr2=0x7f615c11d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615bfff6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615c115410 0x7f615c11d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615bfff6c0 1 -- 10.20.193.28:0/2770468573 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 msgr2=0x7f615c11d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615bfff6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 0x7f615c11d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615bfff6c0 1 -- 10.20.193.28:0/2770468573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615000a660 con 0x7f615c122a70 2026-02-13T01:28:39.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615b7fe6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 0x7f615c11d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:28:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f615bfff6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 0x7f615c122f10 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6150030af0 tx=0x7f61500054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6150003a30 con 0x7f615c122a70 2026-02-13T01:28:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6150003b90 con 0x7f615c122a70 2026-02-13T01:28:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6150038410 con 0x7f615c122a70 2026-02-13T01:28:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615c163c00 con 0x7f615c122a70 2026-02-13T01:28:39.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.154+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615c164030 con 0x7f615c122a70 2026-02-13T01:28:39.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.155+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c1104d0 con 0x7f615c122a70 2026-02-13T01:28:39.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.157+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f6150008350 con 0x7f615c122a70 2026-02-13T01:28:39.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.158+0000 7f6158ff96c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f61300b5680 0x7f61300d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:39.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.159+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f6150108ef0 con 0x7f615c122a70 2026-02-13T01:28:39.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.159+0000 7f615b7fe6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f61300b5680 0x7f61300d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:39.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.159+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61500cb920 con 0x7f615c122a70 2026-02-13T01:28:39.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.159+0000 7f615b7fe6c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f61300b5680 0x7f61300d5b30 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6148004750 tx=0x7f6148009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:39.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.284+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f615c11e2c0 con 0x7f615c122a70 2026-02-13T01:28:39.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.284+0000 7f6158ff96c0 1 -- 10.20.193.28:0/2770468573 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f61500cead0 con 0x7f615c122a70 2026-02-13T01:28:39.286 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:39.286 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:39.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f61300b5680 msgr2=0x7f61300d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:39.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f61300b5680 0x7f61300d5b30 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6148004750 tx=0x7f6148009390 comp rx=0 tx=0).stop 2026-02-13T01:28:39.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 msgr2=0x7f615c122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:39.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 0x7f615c122f10 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6150030af0 tx=0x7f61500054b0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 shutdown_connections 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f61300b5680 0x7f61300d5b30 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f615c115410 0x7f615c11d6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f615c122a70 0x7f615c122f10 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 --2- 10.20.193.28:0/2770468573 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f615c10f200 0x7f615c11d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 >> 10.20.193.28:0/2770468573 conn(0x7f615c0ecb00 msgr2=0x7f615c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 shutdown_connections 2026-02-13T01:28:39.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:39.286+0000 7f6161be36c0 1 -- 10.20.193.28:0/2770468573 wait complete. 2026-02-13T01:28:39.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:39 trial028 ceph-mon[22984]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:39.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:39 trial134 ceph-mon[27948]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:39.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:39 trial187 ceph-mon[27464]: pgmap v294: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:40.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:40 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2770468573' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:40.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:40 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2770468573' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:40.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:40 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2770468573' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:28:41.527 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:28:41.528 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:28:41.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:41.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: pgmap v295: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:28:41.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:41.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:41.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:28:41.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:28:41.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:28:41.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:28:41.697 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:42.391 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:42 trial134 ceph-mon[27948]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:28:42.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:42 trial134 ceph-mon[27948]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:42.575 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:42.617 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:42 trial028 ceph-mon[22984]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:28:42.617 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:42 trial028 ceph-mon[22984]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:42.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:42 trial187 ceph-mon[27464]: pgmap v296: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:28:42.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:42 trial187 ceph-mon[27464]: pgmap v297: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 -- 10.20.193.28:0/3286749253 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4114190 msgr2=0x7fd4d4115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/3286749253 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4114190 0x7fd4d4115d40 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=4190342074392122428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4bc0099a0 tx=0x7fd4bc02ed50 comp rx=0 tx=0).stop 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 -- 10.20.193.28:0/3286749253 shutdown_connections 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/3286749253 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4114190 0x7fd4d4115d40 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=4190342074392122428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/3286749253 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd4d4116520 0x7fd4d417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/3286749253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d4113b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 -- 10.20.193.28:0/3286749253 >> 10.20.193.28:0/3286749253 conn(0x7fd4d4061510 msgr2=0x7fd4d4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:42.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 -- 10.20.193.28:0/3286749253 shutdown_connections 2026-02-13T01:28:42.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.777+0000 7fd4d35776c0 1 -- 10.20.193.28:0/3286749253 wait complete. 2026-02-13T01:28:42.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 Processor -- start 2026-02-13T01:28:42.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 -- start start 2026-02-13T01:28:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d41214d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4116520 0x7fd4d4121a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd4d4126dd0 0x7fd4d4127270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d41277e0 con 0x7fd4d41137a0 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4127950 con 0x7fd4d4126dd0 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d35776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4127b10 con 0x7fd4d4116520 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d25756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d41214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d25756c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d41214d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37558/0 (socket says 10.20.193.28:37558) 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d25756c0 1 -- 10.20.193.28:0/1279497133 learned_addr learned my addr 10.20.193.28:0/1279497133 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d1d746c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4116520 0x7fd4d4121a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.778+0000 7fd4d2d766c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd4d4126dd0 0x7fd4d4127270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d25756c0 1 -- 10.20.193.28:0/1279497133 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4116520 msgr2=0x7fd4d4121a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d25756c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4116520 0x7fd4d4121a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d25756c0 1 -- 10.20.193.28:0/1279497133 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd4d4126dd0 msgr2=0x7fd4d4127270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d25756c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd4d4126dd0 0x7fd4d4127270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d25756c0 1 -- 10.20.193.28:0/1279497133 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc009590 con 0x7fd4d41137a0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d25756c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d41214d0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4c8009490 tx=0x7fd4c800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4c8004a80 con 0x7fd4d41137a0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4c8009030 con 0x7fd4d41137a0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4c80071c0 con 0x7fd4d41137a0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d4167fc0 con 0x7fd4d41137a0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d4168450 con 0x7fd4d41137a0 2026-02-13T01:28:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.779+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d4114840 con 0x7fd4d41137a0 2026-02-13T01:28:42.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.782+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fd4c8004060 con 0x7fd4d41137a0 2026-02-13T01:28:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.784+0000 7fd4bb7fe6c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd4ac0b5680 0x7fd4ac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.784+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fd4c80e3be0 con 0x7fd4d41137a0 2026-02-13T01:28:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.784+0000 7fd4d1d746c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd4ac0b5680 0x7fd4ac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.784+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd4c811c640 con 0x7fd4d41137a0 2026-02-13T01:28:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.784+0000 7fd4d1d746c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd4ac0b5680 0x7fd4ac0d5b30 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4bc0023e0 tx=0x7fd4bc005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:42.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.908+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4d4113b70 con 0x7fd4d41137a0 2026-02-13T01:28:42.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.909+0000 7fd4bb7fe6c0 1 -- 10.20.193.28:0/1279497133 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd4c80a6610 con 0x7fd4d41137a0 2026-02-13T01:28:42.909 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:42.909 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:42.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd4ac0b5680 msgr2=0x7fd4ac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd4ac0b5680 0x7fd4ac0d5b30 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4bc0023e0 tx=0x7fd4bc005c80 comp rx=0 tx=0).stop 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 msgr2=0x7fd4d41214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d41214d0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4c8009490 tx=0x7fd4c800bca0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 shutdown_connections 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fd4ac0b5680 0x7fd4ac0d5b30 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fd4d4116520 0x7fd4d4121a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fd4d4126dd0 0x7fd4d4127270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 --2- 10.20.193.28:0/1279497133 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4d41137a0 0x7fd4d41214d0 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 >> 10.20.193.28:0/1279497133 conn(0x7fd4d4061510 msgr2=0x7fd4d4116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 shutdown_connections 2026-02-13T01:28:42.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:42.910+0000 7fd4d35776c0 1 -- 10.20.193.28:0/1279497133 wait complete. 2026-02-13T01:28:43.551 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:43 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1279497133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:43.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:43 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1279497133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:43.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:43 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1279497133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:44.552 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:44 trial134 ceph-mon[27948]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:28:44.643 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:44 trial187 ceph-mon[27464]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:28:44.696 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:44 trial028 ceph-mon[22984]: pgmap v298: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-13T01:28:46.045 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:46.233 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 -- 10.20.193.28:0/816139783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10fbf0 msgr2=0x7f31cc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 --2- 10.20.193.28:0/816139783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10fbf0 0x7f31cc114c30 secure :-1 s=READY pgs=288 gs=3 cs=0 l=1 c_cookie=10298133027458952869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31b40098d0 tx=0x7f31b402ec40 comp rx=0 tx=0).stop 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 -- 10.20.193.28:0/816139783 shutdown_connections 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 --2- 10.20.193.28:0/816139783 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 0x7f31cc175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 --2- 10.20.193.28:0/816139783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10fbf0 0x7f31cc114c30 unknown :-1 s=CLOSED pgs=288 gs=3 cs=0 l=1 c_cookie=10298133027458952869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 --2- 10.20.193.28:0/816139783 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 0x7f31cc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 -- 10.20.193.28:0/816139783 >> 10.20.193.28:0/816139783 conn(0x7f31cc0ecb00 msgr2=0x7f31cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 -- 10.20.193.28:0/816139783 shutdown_connections 2026-02-13T01:28:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.424+0000 7f31d18f06c0 1 -- 10.20.193.28:0/816139783 wait complete. 2026-02-13T01:28:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 Processor -- start 2026-02-13T01:28:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 -- start start 2026-02-13T01:28:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 0x7f31cc10cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 0x7f31cc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 0x7f31cc10a720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc10af00 con 0x7f31cc10a2b0 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc10b070 con 0x7f31cc115410 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.425+0000 7f31d18f06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc0f0ff0 con 0x7f31cc10f200 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 0x7f31cc10a720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31ca7fc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 0x7f31cc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31caffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 0x7f31cc10cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 0x7f31cc10a720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33290/0 (socket says 10.20.193.28:33290) 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31ca7fc6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 0x7f31cc175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:39290/0 (socket says 10.20.193.28:39290) 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 -- 10.20.193.28:0/764116929 learned_addr learned my addr 10.20.193.28:0/764116929 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 -- 10.20.193.28:0/764116929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 msgr2=0x7f31cc10cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 0x7f31cc10cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 -- 10.20.193.28:0/764116929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 msgr2=0x7f31cc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 0x7f31cc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 -- 10.20.193.28:0/764116929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b40094c0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31caffd6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 0x7f31cc10cff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31cb7fe6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 0x7f31cc10a720 secure :-1 s=READY pgs=289 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31bc006ea0 tx=0x7f31bc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31bc003c40 con 0x7f31cc10a2b0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f31bc003da0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31bc0081c0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31d18f06c0 1 -- 10.20.193.28:0/764116929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc0f1270 con 0x7f31cc10a2b0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.426+0000 7f31d18f06c0 1 -- 10.20.193.28:0/764116929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc0f1700 con 0x7f31cc10a2b0 2026-02-13T01:28:46.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.427+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc1104d0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.429+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f31bc00d590 con 0x7f31cc10a2b0 2026-02-13T01:28:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.430+0000 7f31d08ee6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31a00b5680 0x7f31a00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.430+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f31bc0e4aa0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.431+0000 7f31caffd6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31a00b5680 0x7f31a00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.431+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f31bc11d5e0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.432+0000 7f31caffd6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31a00b5680 0x7f31a00d5b30 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31c0005b40 tx=0x7f31c0009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:46.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.555+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31cc10f5d0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.555+0000 7f31d08ee6c0 1 -- 10.20.193.28:0/764116929 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f31bc0a74d0 con 0x7f31cc10a2b0 2026-02-13T01:28:46.556 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:46.556 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31a00b5680 msgr2=0x7f31a00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31a00b5680 0x7f31a00d5b30 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31c0005b40 tx=0x7f31c0009310 comp rx=0 tx=0).stop 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 msgr2=0x7f31cc10a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 0x7f31cc10a720 secure :-1 s=READY pgs=289 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31bc006ea0 tx=0x7f31bc00ce50 comp rx=0 tx=0).stop 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 shutdown_connections 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f31cc10a2b0 0x7f31cc10a720 unknown :-1 s=CLOSED pgs=289 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f31cc115410 0x7f31cc175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f31a00b5680 0x7f31a00d5b30 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 --2- 10.20.193.28:0/764116929 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f31cc10f200 0x7f31cc10cff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:46.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 >> 10.20.193.28:0/764116929 conn(0x7f31cc0ecb00 msgr2=0x7f31cc113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:46.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 shutdown_connections 2026-02-13T01:28:46.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:46.556+0000 7f31aa7fc6c0 1 -- 10.20.193.28:0/764116929 wait complete. 2026-02-13T01:28:46.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:46 trial028 ceph-mon[22984]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:46.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:46 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/764116929' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:47.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:46 trial134 ceph-mon[27948]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:47.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:46 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/764116929' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:46 trial187 ceph-mon[27464]: pgmap v299: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:46 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/764116929' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:49.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:48 trial134 ceph-mon[27948]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:28:49.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:48 trial187 ceph-mon[27464]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:28:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:48 trial028 ceph-mon[22984]: pgmap v300: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:28:49.659 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:49.843 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:50.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 -- 10.20.193.28:0/1566266444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f007810c2d0 msgr2=0x7f00781108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 --2- 10.20.193.28:0/1566266444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f007810c2d0 0x7f00781108a0 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=15320976016577249049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0068009970 tx=0x7f006802ed50 comp rx=0 tx=0).stop 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 -- 10.20.193.28:0/1566266444 shutdown_connections 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 --2- 10.20.193.28:0/1566266444 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0078110ef0 0x7f0078111370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 --2- 10.20.193.28:0/1566266444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f007810c2d0 0x7f00781108a0 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=15320976016577249049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 --2- 10.20.193.28:0/1566266444 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 0x7f007810bcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 -- 10.20.193.28:0/1566266444 >> 10.20.193.28:0/1566266444 conn(0x7f00780e9570 msgr2=0x7f0078109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.036+0000 7f007cf476c0 1 -- 10.20.193.28:0/1566266444 shutdown_connections 2026-02-13T01:28:50.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.037+0000 7f007cf476c0 1 -- 10.20.193.28:0/1566266444 wait complete. 2026-02-13T01:28:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.037+0000 7f007cf476c0 1 Processor -- start 2026-02-13T01:28:50.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.037+0000 7f007cf476c0 1 -- start start 2026-02-13T01:28:50.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.037+0000 7f007cf476c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 0x7f0078121810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:50.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.037+0000 7f007cf476c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f007810c2d0 0x7f0078121d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:50.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f007cf476c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0078110ef0 0x7f0078127110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:50.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f007cf476c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0078127760 con 0x7f0078110ef0 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f007cf476c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00781278d0 con 0x7f007810b8e0 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f007cf476c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0078127a90 con 0x7f007810c2d0 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0076ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f007810c2d0 0x7f0078121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0078110ef0 0x7f0078127110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0076ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f007810c2d0 0x7f0078121d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:52540/0 (socket says 10.20.193.28:52540) 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0076ffd6c0 1 -- 10.20.193.28:0/3806740575 learned_addr learned my addr 10.20.193.28:0/3806740575 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f00777fe6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 0x7f0078121810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 -- 10.20.193.28:0/3806740575 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f007810c2d0 msgr2=0x7f0078121d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f007810c2d0 0x7f0078121d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 -- 10.20.193.28:0/3806740575 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 msgr2=0x7f0078121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 0x7f0078121810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 -- 10.20.193.28:0/3806740575 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0068009590 con 0x7f0078110ef0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f00777fe6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 0x7f0078121810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0077fff6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0078110ef0 0x7f0078127110 secure :-1 s=READY pgs=291 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f006c006fd0 tx=0x7f006c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f006c003c40 con 0x7f0078110ef0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0078127d70 con 0x7f0078110ef0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f006c00a070 con 0x7f0078110ef0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f006c00de30 con 0x7f0078110ef0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.038+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0078168450 con 0x7f0078110ef0 2026-02-13T01:28:50.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.039+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007805fb90 con 0x7f0078110ef0 2026-02-13T01:28:50.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.041+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f006c005030 con 0x7f0078110ef0 2026-02-13T01:28:50.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.043+0000 7f0074ff96c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f004c0b5680 0x7f004c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:50.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.043+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f006c0e4920 con 0x7f0078110ef0 2026-02-13T01:28:50.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.043+0000 7f00777fe6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f004c0b5680 0x7f004c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:50.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.043+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f006c0e4e10 con 0x7f0078110ef0 2026-02-13T01:28:50.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.043+0000 7f00777fe6c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f004c0b5680 0x7f004c0d5b30 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0064004750 tx=0x7f0064009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:50.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.168+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f007810bcb0 con 0x7f0078110ef0 2026-02-13T01:28:50.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.168+0000 7f0074ff96c0 1 -- 10.20.193.28:0/3806740575 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f006c0a7390 con 0x7f0078110ef0 2026-02-13T01:28:50.169 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:50.169 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f004c0b5680 msgr2=0x7f004c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f004c0b5680 0x7f004c0d5b30 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0064004750 tx=0x7f0064009260 comp rx=0 tx=0).stop 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0078110ef0 msgr2=0x7f0078127110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0078110ef0 0x7f0078127110 secure :-1 s=READY pgs=291 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f006c006fd0 tx=0x7f006c00cc00 comp rx=0 tx=0).stop 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 shutdown_connections 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f004c0b5680 0x7f004c0d5b30 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f007810c2d0 0x7f0078121d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0078110ef0 0x7f0078127110 unknown :-1 s=CLOSED pgs=291 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 --2- 10.20.193.28:0/3806740575 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f007810b8e0 0x7f0078121810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:50.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 >> 10.20.193.28:0/3806740575 conn(0x7f00780e9570 msgr2=0x7f0078109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:50.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 shutdown_connections 2026-02-13T01:28:50.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:50.169+0000 7f007cf476c0 1 -- 10.20.193.28:0/3806740575 wait complete. 2026-02-13T01:28:51.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:50 trial134 ceph-mon[27948]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:51.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:50 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3806740575' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:50 trial187 ceph-mon[27464]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:50 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3806740575' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:51.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:50 trial028 ceph-mon[22984]: pgmap v301: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:28:51.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:50 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3806740575' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:53.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:52 trial134 ceph-mon[27948]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:28:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:52 trial187 ceph-mon[27464]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:28:53.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:52 trial028 ceph-mon[22984]: pgmap v302: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:28:53.272 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:53.457 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:53.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 -- 10.20.193.28:0/3778512503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200577e0 msgr2=0x7f1020057bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 --2- 10.20.193.28:0/3778512503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200577e0 0x7f1020057bb0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=12121821600407341270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f100c009970 tx=0x7f100c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 -- 10.20.193.28:0/3778512503 shutdown_connections 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 --2- 10.20.193.28:0/3778512503 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f10200580f0 0x7f102015d9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 --2- 10.20.193.28:0/3778512503 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f102015df20 0x7f102017e300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 --2- 10.20.193.28:0/3778512503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200577e0 0x7f1020057bb0 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=12121821600407341270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 -- 10.20.193.28:0/3778512503 >> 10.20.193.28:0/3778512503 conn(0x7f102005dc80 msgr2=0x7f102005e080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:53.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 -- 10.20.193.28:0/3778512503 shutdown_connections 2026-02-13T01:28:53.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.661+0000 7f10248766c0 1 -- 10.20.193.28:0/3778512503 wait complete. 2026-02-13T01:28:53.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 Processor -- start 2026-02-13T01:28:53.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 -- start start 2026-02-13T01:28:53.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f10200577e0 0x7f1020169d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:53.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 0x7f102016a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f102015df20 0x7f102016f600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f102016fc50 con 0x7f10200580f0 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f102016fdc0 con 0x7f10200577e0 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.662+0000 7f10248766c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f102016ff80 con 0x7f102015df20 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 0x7f102016a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 0x7f102016a240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33318/0 (socket says 10.20.193.28:33318) 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 -- 10.20.193.28:0/2105522876 learned_addr learned my addr 10.20.193.28:0/2105522876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101f7fe6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f10200577e0 0x7f1020169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101ffff6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f102015df20 0x7f102016f600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 -- 10.20.193.28:0/2105522876 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f102015df20 msgr2=0x7f102016f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:53.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f102015df20 0x7f102016f600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 -- 10.20.193.28:0/2105522876 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f10200577e0 msgr2=0x7f1020169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f10200577e0 0x7f1020169d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 -- 10.20.193.28:0/2105522876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c009590 con 0x7f10200580f0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101effd6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 0x7f102016a240 secure :-1 s=READY pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1010005dc0 tx=0x7f101000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1010004250 con 0x7f10200580f0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1010009070 con 0x7f10200580f0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f101000ce40 con 0x7f10200580f0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1020170260 con 0x7f10200580f0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.663+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1020159b50 con 0x7f10200580f0 2026-02-13T01:28:53.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.664+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1020170480 con 0x7f10200580f0 2026-02-13T01:28:53.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.666+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f10100028c0 con 0x7f10200580f0 2026-02-13T01:28:53.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.668+0000 7f101cff96c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:53.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.668+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f10100e3ac0 con 0x7f10200580f0 2026-02-13T01:28:53.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.668+0000 7f101f7fe6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:53.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.668+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f101011c5e0 con 0x7f10200580f0 2026-02-13T01:28:53.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.669+0000 7f101f7fe6c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f100c0023e0 tx=0x7f100c031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:53.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.792+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f102016ae50 con 0x7f10200580f0 2026-02-13T01:28:53.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.792+0000 7f101cff96c0 1 -- 10.20.193.28:0/2105522876 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10100a64f0 con 0x7f10200580f0 2026-02-13T01:28:53.793 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:53.793 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:53.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 msgr2=0x7f0ff40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:53.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f100c0023e0 tx=0x7f100c031f90 comp rx=0 tx=0).stop 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 msgr2=0x7f102016a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 0x7f102016a240 secure :-1 s=READY pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1010005dc0 tx=0x7f101000bbd0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 shutdown_connections 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0ff40b5680 0x7f0ff40d5b30 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f102015df20 0x7f102016f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f10200580f0 0x7f102016a240 unknown :-1 s=CLOSED pgs=293 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 --2- 10.20.193.28:0/2105522876 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f10200577e0 0x7f1020169d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 >> 10.20.193.28:0/2105522876 conn(0x7f102005dc80 msgr2=0x7f1020113dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 shutdown_connections 2026-02-13T01:28:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:53.794+0000 7f10248766c0 1 -- 10.20.193.28:0/2105522876 wait complete. 2026-02-13T01:28:55.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:54 trial134 ceph-mon[27948]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:55.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:54 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2105522876' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:55.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:54 trial187 ceph-mon[27464]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:55.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:54 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2105522876' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:55.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:54 trial028 ceph-mon[22984]: pgmap v303: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:28:55.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:54 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2105522876' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:56.899 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:57.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:56 trial134 ceph-mon[27948]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:28:57.084 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:28:57.124 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:56 trial028 ceph-mon[22984]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:28:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:56 trial187 ceph-mon[27464]: pgmap v304: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:28:57.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 -- 10.20.193.28:0/3944341865 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410fa50 msgr2=0x7ff8a4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:57.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/3944341865 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410fa50 0x7ff8a4114a90 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=3641586011489808313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff88c0099a0 tx=0x7ff88c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:28:57.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 -- 10.20.193.28:0/3944341865 shutdown_connections 2026-02-13T01:28:57.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/3944341865 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410fa50 0x7ff8a4114a90 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=3641586011489808313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/3944341865 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8a4115270 0x7ff8a4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/3944341865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a410f060 0x7ff8a410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 -- 10.20.193.28:0/3944341865 >> 10.20.193.28:0/3944341865 conn(0x7ff8a40ec980 msgr2=0x7ff8a410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:57.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 -- 10.20.193.28:0/3944341865 shutdown_connections 2026-02-13T01:28:57.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.287+0000 7ff8a35776c0 1 -- 10.20.193.28:0/3944341865 wait complete. 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.288+0000 7ff8a35776c0 1 Processor -- start 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.288+0000 7ff8a35776c0 1 -- start start 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.288+0000 7ff8a35776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410f060 0x7ff8a40f4ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.288+0000 7ff8a35776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 0x7ff8a4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a35776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8a40f50f0 0x7ff8a40fa3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a35776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a40f57e0 con 0x7ff8a4115270 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a35776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a40fa900 con 0x7ff8a40f50f0 2026-02-13T01:28:57.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a35776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a40faac0 con 0x7ff8a410f060 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 0x7ff8a4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 0x7ff8a4175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48266/0 (socket says 10.20.193.28:48266) 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 -- 10.20.193.28:0/1515781323 learned_addr learned my addr 10.20.193.28:0/1515781323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a25756c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410f060 0x7ff8a40f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a2d766c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8a40f50f0 0x7ff8a40fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 -- 10.20.193.28:0/1515781323 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410f060 msgr2=0x7ff8a40f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410f060 0x7ff8a40f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 -- 10.20.193.28:0/1515781323 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8a40f50f0 msgr2=0x7ff8a40fa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8a40f50f0 0x7ff8a40fa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 -- 10.20.193.28:0/1515781323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c009590 con 0x7ff8a4115270 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a1d746c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 0x7ff8a4175b10 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff88c02f210 tx=0x7ff88c02fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:57.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff88c002ae0 con 0x7ff8a4115270 2026-02-13T01:28:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.289+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a40fad40 con 0x7ff8a4115270 2026-02-13T01:28:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.290+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff88c0046b0 con 0x7ff8a4115270 2026-02-13T01:28:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.290+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff88c037590 con 0x7ff8a4115270 2026-02-13T01:28:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.290+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a40fb210 con 0x7ff8a4115270 2026-02-13T01:28:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.291+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a4110330 con 0x7ff8a4115270 2026-02-13T01:28:57.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.292+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ff88c007b90 con 0x7ff8a4115270 2026-02-13T01:28:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.294+0000 7ff88b7fe6c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff87c0b5680 0x7ff87c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.294+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7ff88c107b70 con 0x7ff8a4115270 2026-02-13T01:28:57.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.294+0000 7ff8a25756c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff87c0b5680 0x7ff87c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:57.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.295+0000 7ff8a25756c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff87c0b5680 0x7ff87c0d5b30 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff898004750 tx=0x7ff898009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:57.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.295+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff88c0ca5a0 con 0x7ff8a4115270 2026-02-13T01:28:57.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.423+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8a410fa00 con 0x7ff8a4115270 2026-02-13T01:28:57.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.424+0000 7ff88b7fe6c0 1 -- 10.20.193.28:0/1515781323 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff88c0cd750 con 0x7ff8a4115270 2026-02-13T01:28:57.424 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:28:57.425 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:57.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff87c0b5680 msgr2=0x7ff87c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:57.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff87c0b5680 0x7ff87c0d5b30 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff898004750 tx=0x7ff898009260 comp rx=0 tx=0).stop 2026-02-13T01:28:57.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 msgr2=0x7ff8a4175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 0x7ff8a4175b10 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff88c02f210 tx=0x7ff88c02fc60 comp rx=0 tx=0).stop 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 shutdown_connections 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff8a40f50f0 0x7ff8a40fa3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8a4115270 0x7ff8a4175b10 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff87c0b5680 0x7ff87c0d5b30 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 --2- 10.20.193.28:0/1515781323 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff8a410f060 0x7ff8a40f4ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 >> 10.20.193.28:0/1515781323 conn(0x7ff8a40ec980 msgr2=0x7ff8a4111a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 shutdown_connections 2026-02-13T01:28:57.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:28:57.426+0000 7ff8a35776c0 1 -- 10.20.193.28:0/1515781323 wait complete. 2026-02-13T01:28:58.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:57 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1515781323' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:58.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:57 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1515781323' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:58.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:57 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1515781323' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:59.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:28:58 trial134 ceph-mon[27948]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:28:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:28:58 trial187 ceph-mon[27464]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:28:59.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:28:58 trial028 ceph-mon[22984]: pgmap v305: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:00.531 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:00.716 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:00.848 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:00 trial028 ceph-mon[22984]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/1124352449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810db80 msgr2=0x7f38f810df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/1124352449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810db80 0x7f38f810df50 secure :-1 s=READY pgs=295 gs=2 cs=0 l=1 c_cookie=11802399273427903142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e8009970 tx=0x7f38e802ed10 comp rx=0 tx=0).stop 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/1124352449 shutdown_connections 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/1124352449 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38f810e570 0x7f38f8152bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/1124352449 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f8153130 0x7f38f8173550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/1124352449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810db80 0x7f38f810df50 unknown :-1 s=CLOSED pgs=295 gs=2 cs=0 l=1 c_cookie=11802399273427903142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/1124352449 >> 10.20.193.28:0/1124352449 conn(0x7f38f80e9590 msgr2=0x7f38f81099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/1124352449 shutdown_connections 2026-02-13T01:29:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.905+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/1124352449 wait complete. 2026-02-13T01:29:00.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 Processor -- start 2026-02-13T01:29:00.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 -- start start 2026-02-13T01:29:00.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f810db80 0x7f38f8161120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 0x7f38f8161660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38f8153130 0x7f38f8166a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8167070 con 0x7f38f810e570 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81671e0 con 0x7f38f810db80 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38fdc5b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81673a0 con 0x7f38f8153130 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.906+0000 7f38effff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 0x7f38f8161660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 0x7f38f8161660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48282/0 (socket says 10.20.193.28:48282) 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 -- 10.20.193.28:0/2048243571 learned_addr learned my addr 10.20.193.28:0/2048243571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38fcc596c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f810db80 0x7f38f8161120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38fd45a6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38f8153130 0x7f38f8166a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 -- 10.20.193.28:0/2048243571 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38f8153130 msgr2=0x7f38f8166a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38f8153130 0x7f38f8166a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:00.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 -- 10.20.193.28:0/2048243571 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f810db80 msgr2=0x7f38f8161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f810db80 0x7f38f8161120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 -- 10.20.193.28:0/2048243571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8009590 con 0x7f38f810e570 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38fcc596c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f810db80 0x7f38f8161120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38effff6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 0x7f38f8161660 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e0009490 tx=0x7f38e000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e0004a80 con 0x7f38f810e570 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38e0009030 con 0x7f38f810e570 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38e0004a80 con 0x7f38f810e570 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f8167680 con 0x7f38f810e570 2026-02-13T01:29:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.907+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f814ed60 con 0x7f38f810e570 2026-02-13T01:29:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.908+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f81678a0 con 0x7f38f810e570 2026-02-13T01:29:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.910+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f38e000cc60 con 0x7f38f810e570 2026-02-13T01:29:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.912+0000 7f38edffb6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38d40b5760 0x7f38d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.912+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f38e00e36f0 con 0x7f38f810e570 2026-02-13T01:29:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.912+0000 7f38fcc596c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38d40b5760 0x7f38d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.912+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38e00e3af0 con 0x7f38f810e570 2026-02-13T01:29:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:00.913+0000 7f38fcc596c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38d40b5760 0x7f38d40d5c10 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e802f960 tx=0x7f38e80023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.037+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38f8162270 con 0x7f38f810e570 2026-02-13T01:29:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.037+0000 7f38edffb6c0 1 -- 10.20.193.28:0/2048243571 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38e00a6120 con 0x7f38f810e570 2026-02-13T01:29:01.037 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:01.037 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38d40b5760 msgr2=0x7f38d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38d40b5760 0x7f38d40d5c10 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e802f960 tx=0x7f38e80023a0 comp rx=0 tx=0).stop 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 msgr2=0x7f38f8161660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 0x7f38f8161660 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38e0009490 tx=0x7f38e000bc50 comp rx=0 tx=0).stop 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 shutdown_connections 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f38d40b5760 0x7f38d40d5c10 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f38f8153130 0x7f38f8166a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f38f810e570 0x7f38f8161660 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 --2- 10.20.193.28:0/2048243571 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f38f810db80 0x7f38f8161120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 >> 10.20.193.28:0/2048243571 conn(0x7f38f80e9590 msgr2=0x7f38f8109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 shutdown_connections 2026-02-13T01:29:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:01.038+0000 7f38fdc5b6c0 1 -- 10.20.193.28:0/2048243571 wait complete. 2026-02-13T01:29:01.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:00 trial134 ceph-mon[27948]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:00 trial187 ceph-mon[27464]: pgmap v306: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:01.893 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:01 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2048243571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:02.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:01 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2048243571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:02.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:01 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2048243571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:03.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:02 trial134 ceph-mon[27948]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:02 trial187 ceph-mon[27464]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:03.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:02 trial028 ceph-mon[22984]: pgmap v307: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:04.144 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:04.331 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:04.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 -- 10.20.193.28:0/3375327415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 msgr2=0x7f0190175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/3375327415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f0190175c10 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=15354431434358982644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f018000aa70 tx=0x7f018002fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 -- 10.20.193.28:0/3375327415 shutdown_connections 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/3375327415 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f019010fa50 0x7f0190114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/3375327415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f0190175c10 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=15354431434358982644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/3375327415 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f019010f060 0x7f019010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 -- 10.20.193.28:0/3375327415 >> 10.20.193.28:0/3375327415 conn(0x7f01900ec980 msgr2=0x7f019010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 -- 10.20.193.28:0/3375327415 shutdown_connections 2026-02-13T01:29:04.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.531+0000 7f018ffff6c0 1 -- 10.20.193.28:0/3375327415 wait complete. 2026-02-13T01:29:04.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.532+0000 7f018ffff6c0 1 Processor -- start 2026-02-13T01:29:04.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.532+0000 7f018ffff6c0 1 -- start start 2026-02-13T01:29:04.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f019010f060 0x7f019011cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f019011d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0190122860 0x7f0190122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0190123270 con 0x7f0190115270 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01901233e0 con 0x7f0190122860 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f01901235a0 con 0x7f019010f060 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f019011d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f019011d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48302/0 (socket says 10.20.193.28:48302) 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 -- 10.20.193.28:0/2891219770 learned_addr learned my addr 10.20.193.28:0/2891219770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018effd6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f019010f060 0x7f019011cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018f7fe6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0190122860 0x7f0190122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:04.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 -- 10.20.193.28:0/2891219770 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f019010f060 msgr2=0x7f019011cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f019010f060 0x7f019011cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 -- 10.20.193.28:0/2891219770 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0190122860 msgr2=0x7f0190122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0190122860 0x7f0190122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 -- 10.20.193.28:0/2891219770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018000a660 con 0x7f0190115270 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018f7fe6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0190122860 0x7f0190122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018e7fc6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f019011d4a0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f017800b6c0 tx=0x7f017800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0178004250 con 0x7f0190115270 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0178009070 con 0x7f0190115270 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f017800cd20 con 0x7f0190115270 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.533+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0190163a50 con 0x7f0190115270 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.534+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0190163ee0 con 0x7f0190115270 2026-02-13T01:29:04.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.534+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0190110330 con 0x7f0190115270 2026-02-13T01:29:04.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.536+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f01780028c0 con 0x7f0190115270 2026-02-13T01:29:04.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.538+0000 7f0194a7a6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01640b5680 0x7f01640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:04.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.538+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f01780e3ac0 con 0x7f0190115270 2026-02-13T01:29:04.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.538+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f017811c5e0 con 0x7f0190115270 2026-02-13T01:29:04.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.538+0000 7f018effd6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01640b5680 0x7f01640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:04.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.539+0000 7f018effd6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01640b5680 0x7f01640d5b30 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0184005980 tx=0x7f0184005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:04.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.662+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f019010f430 con 0x7f0190115270 2026-02-13T01:29:04.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.662+0000 7f0194a7a6c0 1 -- 10.20.193.28:0/2891219770 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f01780a64f0 con 0x7f0190115270 2026-02-13T01:29:04.663 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:04.663 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:04.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01640b5680 msgr2=0x7f01640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:04.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01640b5680 0x7f01640d5b30 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0184005980 tx=0x7f0184005910 comp rx=0 tx=0).stop 2026-02-13T01:29:04.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 msgr2=0x7f019011d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:04.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f019011d4a0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f017800b6c0 tx=0x7f017800bb90 comp rx=0 tx=0).stop 2026-02-13T01:29:04.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 shutdown_connections 2026-02-13T01:29:04.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0190122860 0x7f0190122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0190115270 0x7f019011d4a0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f01640b5680 0x7f01640d5b30 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 --2- 10.20.193.28:0/2891219770 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f019010f060 0x7f019011cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:04.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.663+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 >> 10.20.193.28:0/2891219770 conn(0x7f01900ec980 msgr2=0x7f019010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:04.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.664+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 shutdown_connections 2026-02-13T01:29:04.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:04.664+0000 7f018ffff6c0 1 -- 10.20.193.28:0/2891219770 wait complete. 2026-02-13T01:29:05.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:04 trial134 ceph-mon[27948]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:05.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:04 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2891219770' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:04 trial187 ceph-mon[27464]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:04 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2891219770' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:04 trial028 ceph-mon[22984]: pgmap v308: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:04 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2891219770' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:07.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:06 trial134 ceph-mon[27948]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:07.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:06 trial187 ceph-mon[27464]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:06 trial028 ceph-mon[22984]: pgmap v309: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:07.767 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:07.954 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:08.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 -- 10.20.193.28:0/799791546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b811b3f0 msgr2=0x7f80b811b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:08.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 --2- 10.20.193.28:0/799791546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b811b3f0 0x7f80b811b7c0 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=10581179282352898017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ac009970 tx=0x7f80ac02ed10 comp rx=0 tx=0).stop 2026-02-13T01:29:08.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 -- 10.20.193.28:0/799791546 shutdown_connections 2026-02-13T01:29:08.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 --2- 10.20.193.28:0/799791546 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b8118f30 0x7f80b8119380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 --2- 10.20.193.28:0/799791546 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b81199a0 0x7f80b8116df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 --2- 10.20.193.28:0/799791546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b811b3f0 0x7f80b811b7c0 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=10581179282352898017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.147+0000 7f80b75776c0 1 -- 10.20.193.28:0/799791546 >> 10.20.193.28:0/799791546 conn(0x7f80b805b290 msgr2=0x7f80b805b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:08.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.148+0000 7f80b75776c0 1 -- 10.20.193.28:0/799791546 shutdown_connections 2026-02-13T01:29:08.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.148+0000 7f80b75776c0 1 -- 10.20.193.28:0/799791546 wait complete. 2026-02-13T01:29:08.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.148+0000 7f80b75776c0 1 Processor -- start 2026-02-13T01:29:08.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.148+0000 7f80b75776c0 1 -- start start 2026-02-13T01:29:08.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b8118f30 0x7f80b80fdd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:08.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 0x7f80b80fe290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:08.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b811b3f0 0x7f80b8103600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8103c50 con 0x7f80b81199a0 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8103dc0 con 0x7f80b8118f30 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8103f80 con 0x7f80b811b3f0 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 0x7f80b80fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 0x7f80b80fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42288/0 (socket says 10.20.193.28:42288) 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 -- 10.20.193.28:0/104342835 learned_addr learned my addr 10.20.193.28:0/104342835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b65756c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b8118f30 0x7f80b80fdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b6d766c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b811b3f0 0x7f80b8103600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 -- 10.20.193.28:0/104342835 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b811b3f0 msgr2=0x7f80b8103600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b811b3f0 0x7f80b8103600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 -- 10.20.193.28:0/104342835 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b8118f30 msgr2=0x7f80b80fdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b8118f30 0x7f80b80fdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 -- 10.20.193.28:0/104342835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac009590 con 0x7f80b81199a0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b6d766c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b811b3f0 0x7f80b8103600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b65756c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b8118f30 0x7f80b80fdd50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b5d746c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 0x7f80b80fe290 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80a0005dc0 tx=0x7f80a000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80a0004250 con 0x7f80b81199a0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f80a0009070 con 0x7f80b81199a0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80a000cde0 con 0x7f80b81199a0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.149+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b8104260 con 0x7f80b81199a0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.150+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b8104920 con 0x7f80b81199a0 2026-02-13T01:29:08.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.150+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b8104480 con 0x7f80b81199a0 2026-02-13T01:29:08.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.153+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f80a00028c0 con 0x7f80b81199a0 2026-02-13T01:29:08.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.154+0000 7f809f7fe6c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f80900b5680 0x7f80900d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:08.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.155+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f80a00e3a50 con 0x7f80b81199a0 2026-02-13T01:29:08.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.155+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f80a011c5e0 con 0x7f80b81199a0 2026-02-13T01:29:08.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.155+0000 7f80b65756c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f80900b5680 0x7f80900d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:08.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.155+0000 7f80b65756c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f80900b5680 0x7f80900d5b30 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ac0023e0 tx=0x7f80ac0091e0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.278+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f80b805e670 con 0x7f80b81199a0 2026-02-13T01:29:08.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.278+0000 7f809f7fe6c0 1 -- 10.20.193.28:0/104342835 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f80a00a6480 con 0x7f80b81199a0 2026-02-13T01:29:08.279 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:08.279 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.279+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f80900b5680 msgr2=0x7f80900d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.279+0000 7f80b75776c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f80900b5680 0x7f80900d5b30 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80ac0023e0 tx=0x7f80ac0091e0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.279+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 msgr2=0x7f80b80fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.279+0000 7f80b75776c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 0x7f80b80fe290 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80a0005dc0 tx=0x7f80a000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 shutdown_connections 2026-02-13T01:29:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f80900b5680 0x7f80900d5b30 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f80b811b3f0 0x7f80b8103600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f80b81199a0 0x7f80b80fe290 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 --2- 10.20.193.28:0/104342835 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f80b8118f30 0x7f80b80fdd50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 >> 10.20.193.28:0/104342835 conn(0x7f80b805b290 msgr2=0x7f80b80f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 shutdown_connections 2026-02-13T01:29:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:08.280+0000 7f80b75776c0 1 -- 10.20.193.28:0/104342835 wait complete. 2026-02-13T01:29:09.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:08 trial134 ceph-mon[27948]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:09.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:08 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/104342835' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:09.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:08 trial187 ceph-mon[27464]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:09.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:08 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/104342835' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:08 trial028 ceph-mon[22984]: pgmap v310: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:08 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/104342835' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:11.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:10 trial134 ceph-mon[27948]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:11.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:10 trial187 ceph-mon[27464]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:10 trial028 ceph-mon[22984]: pgmap v311: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:11.385 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:11.571 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:11.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/2360075214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c1598b0 msgr2=0x7f2e8c179d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:11.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/2360075214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c1598b0 0x7f2e8c179d10 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=426680431121362949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e8000aa40 tx=0x7f2e8002fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/2360075214 shutdown_connections 2026-02-13T01:29:11.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/2360075214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c1598b0 0x7f2e8c179d10 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=426680431121362949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/2360075214 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2e8c062fd0 0x7f2e8c063400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/2360075214 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2e8c0669a0 0x7f2e8c0629b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.764+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/2360075214 >> 10.20.193.28:0/2360075214 conn(0x7f2e8c0ec980 msgr2=0x7f2e8c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:11.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.765+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/2360075214 shutdown_connections 2026-02-13T01:29:11.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.765+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/2360075214 wait complete. 2026-02-13T01:29:11.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 Processor -- start 2026-02-13T01:29:11.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 -- start start 2026-02-13T01:29:11.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2e8c062fd0 0x7f2e8c163060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:11.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2e8c1598b0 0x7f2e8c1635a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:11.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 0x7f2e8c168e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c169370 con 0x7f2e8c168960 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c1694e0 con 0x7f2e8c062fd0 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e90ac76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c1696a0 con 0x7f2e8c1598b0 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e8bfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 0x7f2e8c168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e8bfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 0x7f2e8c168e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42318/0 (socket says 10.20.193.28:42318) 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e8bfff6c0 1 -- 10.20.193.28:0/4225756809 learned_addr learned my addr 10.20.193.28:0/4225756809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e8b7fe6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2e8c062fd0 0x7f2e8c163060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.766+0000 7f2e8affd6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2e8c1598b0 0x7f2e8c1635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e8bfff6c0 1 -- 10.20.193.28:0/4225756809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2e8c1598b0 msgr2=0x7f2e8c1635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e8bfff6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2e8c1598b0 0x7f2e8c1635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e8bfff6c0 1 -- 10.20.193.28:0/4225756809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2e8c062fd0 msgr2=0x7f2e8c163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:11.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e8bfff6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2e8c062fd0 0x7f2e8c163060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e8bfff6c0 1 -- 10.20.193.28:0/4225756809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8000a660 con 0x7f2e8c168960 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e8bfff6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 0x7f2e8c168e00 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e8000a390 tx=0x7f2e800054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e80003a30 con 0x7f2e8c168960 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2e80003b90 con 0x7f2e8c168960 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e80038380 con 0x7f2e8c168960 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c157710 con 0x7f2e8c168960 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.767+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c157b40 con 0x7f2e8c168960 2026-02-13T01:29:11.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.768+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c063ec0 con 0x7f2e8c168960 2026-02-13T01:29:11.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.770+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f2e800088c0 con 0x7f2e8c168960 2026-02-13T01:29:11.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.772+0000 7f2e88ff96c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2e600b5680 0x7f2e600d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:11.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.772+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f2e80108e60 con 0x7f2e8c168960 2026-02-13T01:29:11.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.772+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2e801092e0 con 0x7f2e8c168960 2026-02-13T01:29:11.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.772+0000 7f2e8b7fe6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2e600b5680 0x7f2e600d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:11.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.772+0000 7f2e8b7fe6c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2e600b5680 0x7f2e600d5b30 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e78005980 tx=0x7f2e78005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:11.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.898+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e8c062980 con 0x7f2e8c168960 2026-02-13T01:29:11.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.898+0000 7f2e88ff96c0 1 -- 10.20.193.28:0/4225756809 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2e800cb890 con 0x7f2e8c168960 2026-02-13T01:29:11.898 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:11.898 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:11.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.899+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2e600b5680 msgr2=0x7f2e600d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:11.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.899+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2e600b5680 0x7f2e600d5b30 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e78005980 tx=0x7f2e78005910 comp rx=0 tx=0).stop 2026-02-13T01:29:11.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.899+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 msgr2=0x7f2e8c168e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:11.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.899+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 0x7f2e8c168e00 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e8000a390 tx=0x7f2e800054b0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 shutdown_connections 2026-02-13T01:29:11.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f2e600b5680 0x7f2e600d5b30 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f2e8c1598b0 0x7f2e8c1635a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8c168960 0x7f2e8c168e00 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 --2- 10.20.193.28:0/4225756809 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f2e8c062fd0 0x7f2e8c163060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 >> 10.20.193.28:0/4225756809 conn(0x7f2e8c0ec980 msgr2=0x7f2e8c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 shutdown_connections 2026-02-13T01:29:11.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:11.900+0000 7f2e90ac76c0 1 -- 10.20.193.28:0/4225756809 wait complete. 2026-02-13T01:29:13.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:12 trial134 ceph-mon[27948]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:13.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:12 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4225756809' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:13.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:12 trial187 ceph-mon[27464]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:13.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:12 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4225756809' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:13.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:12 trial028 ceph-mon[22984]: pgmap v312: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:13.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:12 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4225756809' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:15.007 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:15.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:14 trial134 ceph-mon[27948]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:15.057 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:14 trial028 ceph-mon[22984]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:14 trial187 ceph-mon[27464]: pgmap v313: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:15.191 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:15.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 -- 10.20.193.28:0/2170650063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba1410fa50 msgr2=0x7fba14114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:15.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/2170650063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba1410fa50 0x7fba14114a90 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=5047270136752525579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba080099a0 tx=0x7fba0802ed00 comp rx=0 tx=0).stop 2026-02-13T01:29:15.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 -- 10.20.193.28:0/2170650063 shutdown_connections 2026-02-13T01:29:15.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/2170650063 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba14115270 0x7fba14175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/2170650063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba1410fa50 0x7fba14114a90 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=5047270136752525579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/2170650063 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fba1410f060 0x7fba1410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 -- 10.20.193.28:0/2170650063 >> 10.20.193.28:0/2170650063 conn(0x7fba140ec980 msgr2=0x7fba1410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.401+0000 7fba1ab276c0 1 -- 10.20.193.28:0/2170650063 shutdown_connections 2026-02-13T01:29:15.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.402+0000 7fba1ab276c0 1 -- 10.20.193.28:0/2170650063 wait complete. 2026-02-13T01:29:15.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 Processor -- start 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 -- start start 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 0x7fba140f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fba14115270 0x7fba14175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba140f4ff0 0x7fba140fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fba140f56e0 con 0x7fba140f4ff0 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba140fa7b0 con 0x7fba14115270 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1ab276c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fba140fa970 con 0x7fba1410f060 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba19b256c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 0x7fba140f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba19b256c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 0x7fba140f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:38340/0 (socket says 10.20.193.28:38340) 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba19b256c0 1 -- 10.20.193.28:0/3682018621 learned_addr learned my addr 10.20.193.28:0/3682018621 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:15.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba193246c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fba14115270 0x7fba14175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba1a3266c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba140f4ff0 0x7fba140fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba19b256c0 1 -- 10.20.193.28:0/3682018621 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fba14115270 msgr2=0x7fba14175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.403+0000 7fba19b256c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fba14115270 0x7fba14175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba19b256c0 1 -- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba140f4ff0 msgr2=0x7fba140fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba19b256c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba140f4ff0 0x7fba140fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba19b256c0 1 -- 10.20.193.28:0/3682018621 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08009590 con 0x7fba1410f060 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba19b256c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 0x7fba140f49c0 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0400b740 tx=0x7fba0400bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba04004250 con 0x7fba1410f060 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba04009070 con 0x7fba1410f060 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba140fac50 con 0x7fba1410f060 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba0400cda0 con 0x7fba1410f060 2026-02-13T01:29:15.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.404+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba140fb3e0 con 0x7fba1410f060 2026-02-13T01:29:15.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.405+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14110330 con 0x7fba1410f060 2026-02-13T01:29:15.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.407+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fba040028c0 con 0x7fba1410f060 2026-02-13T01:29:15.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.408+0000 7fba02ffd6c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9f00b5600 0x7fb9f00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:15.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.408+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fba040e3a10 con 0x7fba1410f060 2026-02-13T01:29:15.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.408+0000 7fba193246c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9f00b5600 0x7fb9f00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:15.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.409+0000 7fba193246c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9f00b5600 0x7fb9f00d5ab0 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba140fb300 tx=0x7fba080023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:15.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.409+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fba040a6440 con 0x7fba1410f060 2026-02-13T01:29:15.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.534+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba140f5ac0 con 0x7fba1410f060 2026-02-13T01:29:15.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.534+0000 7fba02ffd6c0 1 -- 10.20.193.28:0/3682018621 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fba040a95f0 con 0x7fba1410f060 2026-02-13T01:29:15.534 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:15.535 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:15.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9f00b5600 msgr2=0x7fb9f00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:15.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9f00b5600 0x7fb9f00d5ab0 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba140fb300 tx=0x7fba080023a0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 msgr2=0x7fba140f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:15.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 0x7fba140f49c0 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0400b740 tx=0x7fba0400bc10 comp rx=0 tx=0).stop 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 shutdown_connections 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba140f4ff0 0x7fba140fa270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fba14115270 0x7fba14175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fb9f00b5600 0x7fb9f00d5ab0 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 --2- 10.20.193.28:0/3682018621 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fba1410f060 0x7fba140f49c0 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 >> 10.20.193.28:0/3682018621 conn(0x7fba140ec980 msgr2=0x7fba1410d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 shutdown_connections 2026-02-13T01:29:15.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:15.535+0000 7fba1ab276c0 1 -- 10.20.193.28:0/3682018621 wait complete. 2026-02-13T01:29:15.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:15 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3682018621' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:16.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:15 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3682018621' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:16.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:15 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3682018621' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:17.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:16 trial134 ceph-mon[27948]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:16 trial187 ceph-mon[27464]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:17.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:16 trial028 ceph-mon[22984]: pgmap v314: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:18.648 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:18.835 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:18.965 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:18 trial028 ceph-mon[22984]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:19.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 -- 10.20.193.28:0/3528500014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10fa50 msgr2=0x7f813c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3528500014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10fa50 0x7f813c114a90 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=5968973283198223028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81240099a0 tx=0x7f812402ed00 comp rx=0 tx=0).stop 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 -- 10.20.193.28:0/3528500014 shutdown_connections 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3528500014 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f813c115270 0x7f813c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3528500014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10fa50 0x7f813c114a90 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=5968973283198223028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3528500014 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f813c10f060 0x7f813c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 -- 10.20.193.28:0/3528500014 >> 10.20.193.28:0/3528500014 conn(0x7f813c0ec980 msgr2=0x7f813c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 -- 10.20.193.28:0/3528500014 shutdown_connections 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.028+0000 7f81419c46c0 1 -- 10.20.193.28:0/3528500014 wait complete. 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 Processor -- start 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 -- start start 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 0x7f813c0f4a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f813c115270 0x7f813c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f813c0f5070 0x7f813c0fa340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0f5760 con 0x7f813c10f060 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0fa880 con 0x7f813c0f5070 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81419c46c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0faa40 con 0x7f813c115270 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.029+0000 7f81409c26c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 0x7f813c0f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 0x7f813c0f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57390/0 (socket says 10.20.193.28:57390) 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 -- 10.20.193.28:0/3456524019 learned_addr learned my addr 10.20.193.28:0/3456524019 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f8133fff6c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f813c115270 0x7f813c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81411c36c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f813c0f5070 0x7f813c0fa340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 -- 10.20.193.28:0/3456524019 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f813c115270 msgr2=0x7f813c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f813c115270 0x7f813c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 -- 10.20.193.28:0/3456524019 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f813c0f5070 msgr2=0x7f813c0fa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f813c0f5070 0x7f813c0fa340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 -- 10.20.193.28:0/3456524019 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8124009590 con 0x7f813c10f060 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81409c26c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 0x7f813c0f4a40 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812c009490 tx=0x7f812c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f812c004a80 con 0x7f813c10f060 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f812c009030 con 0x7f813c10f060 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f812c00ce70 con 0x7f813c10f060 2026-02-13T01:29:19.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c0fad20 con 0x7f813c10f060 2026-02-13T01:29:19.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.030+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c0fb1b0 con 0x7f813c10f060 2026-02-13T01:29:19.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.031+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c110330 con 0x7f813c10f060 2026-02-13T01:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.033+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f812c004ce0 con 0x7f813c10f060 2026-02-13T01:29:19.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.035+0000 7f8131ffb6c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f81180b5680 0x7f81180d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.035+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f812c0e38e0 con 0x7f813c10f060 2026-02-13T01:29:19.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.035+0000 7f8133fff6c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f81180b5680 0x7f81180d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.035+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f812c0e3dd0 con 0x7f813c10f060 2026-02-13T01:29:19.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.036+0000 7f8133fff6c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f81180b5680 0x7f81180d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81240023e0 tx=0x7f8124005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:19.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:18 trial134 ceph-mon[27948]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:19.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:18 trial187 ceph-mon[27464]: pgmap v315: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.159+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f813c10f430 con 0x7f813c10f060 2026-02-13T01:29:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.159+0000 7f8131ffb6c0 1 -- 10.20.193.28:0/3456524019 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f812c0a6350 con 0x7f813c10f060 2026-02-13T01:29:19.160 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:19.161 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f81180b5680 msgr2=0x7f81180d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f81180b5680 0x7f81180d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81240023e0 tx=0x7f8124005c00 comp rx=0 tx=0).stop 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 msgr2=0x7f813c0f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 0x7f813c0f4a40 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f812c009490 tx=0x7f812c00bc50 comp rx=0 tx=0).stop 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 shutdown_connections 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f81180b5680 0x7f81180d5b30 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f813c115270 0x7f813c175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f813c0f5070 0x7f813c0fa340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 --2- 10.20.193.28:0/3456524019 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f813c10f060 0x7f813c0f4a40 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.160+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 >> 10.20.193.28:0/3456524019 conn(0x7f813c0ec980 msgr2=0x7f813c10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.161+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 shutdown_connections 2026-02-13T01:29:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:19.161+0000 7f81419c46c0 1 -- 10.20.193.28:0/3456524019 wait complete. 2026-02-13T01:29:20.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:19 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3456524019' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:20.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:19 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3456524019' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:20.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:19 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3456524019' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:21.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:20 trial134 ceph-mon[27948]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:21.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:20 trial187 ceph-mon[27464]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:21.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:20 trial028 ceph-mon[22984]: pgmap v316: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:22.264 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:22.451 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:22.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/1887149896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d410fa50 msgr2=0x7f78d4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/1887149896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d410fa50 0x7f78d4114a90 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=11337885931683653420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78bc0098d0 tx=0x7f78bc02ec40 comp rx=0 tx=0).stop 2026-02-13T01:29:22.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/1887149896 shutdown_connections 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/1887149896 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78d4115270 0x7f78d4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/1887149896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d410fa50 0x7f78d4114a90 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=11337885931683653420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/1887149896 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/1887149896 >> 10.20.193.28:0/1887149896 conn(0x7f78d40ec980 msgr2=0x7f78d410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/1887149896 shutdown_connections 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.645+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/1887149896 wait complete. 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 Processor -- start 2026-02-13T01:29:22.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 -- start start 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d40f4a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78d4115270 0x7f78d4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d40f50a0 0x7f78d40fa370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40f5790 con 0x7f78d40f50a0 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40fa8b0 con 0x7f78d4115270 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.646+0000 7f78d3fff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f78d40faa70 con 0x7f78d410f060 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d2ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d40f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d2ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d40f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:35494/0 (socket says 10.20.193.28:35494) 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d2ffd6c0 1 -- 10.20.193.28:0/463515299 learned_addr learned my addr 10.20.193.28:0/463515299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d40f50a0 0x7f78d40fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d27fc6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78d4115270 0x7f78d4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 -- 10.20.193.28:0/463515299 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 msgr2=0x7f78d40f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d40f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 -- 10.20.193.28:0/463515299 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78d4115270 msgr2=0x7f78d4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78d4115270 0x7f78d4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 -- 10.20.193.28:0/463515299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc0094c0 con 0x7f78d40f50a0 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d2ffd6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d40f4a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d37fe6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d40f50a0 0x7f78d40fa370 secure :-1 s=READY pgs=307 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78c4006fd0 tx=0x7f78c400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:22.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78c4003c40 con 0x7f78d40f50a0 2026-02-13T01:29:22.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d40fad50 con 0x7f78d40f50a0 2026-02-13T01:29:22.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78c400a070 con 0x7f78d40f50a0 2026-02-13T01:29:22.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78c400ddc0 con 0x7f78d40f50a0 2026-02-13T01:29:22.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.647+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d40fb4e0 con 0x7f78d40f50a0 2026-02-13T01:29:22.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.648+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d4110330 con 0x7f78d40f50a0 2026-02-13T01:29:22.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.650+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f78c4005030 con 0x7f78d40f50a0 2026-02-13T01:29:22.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.652+0000 7f78d88076c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f78a80b5680 0x7f78a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.652+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f78c40e47e0 con 0x7f78d40f50a0 2026-02-13T01:29:22.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.652+0000 7f78d2ffd6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f78a80b5680 0x7f78a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.652+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f78c40e4cd0 con 0x7f78d40f50a0 2026-02-13T01:29:22.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.653+0000 7f78d2ffd6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f78a80b5680 0x7f78a80d5b30 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78c8004750 tx=0x7f78c8009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.779+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f78d40f5bc0 con 0x7f78d40f50a0 2026-02-13T01:29:22.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.779+0000 7f78d88076c0 1 -- 10.20.193.28:0/463515299 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f78c40a7250 con 0x7f78d40f50a0 2026-02-13T01:29:22.781 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:22.781 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:22.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f78a80b5680 msgr2=0x7f78a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f78a80b5680 0x7f78a80d5b30 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78c8004750 tx=0x7f78c8009310 comp rx=0 tx=0).stop 2026-02-13T01:29:22.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d40f50a0 msgr2=0x7f78d40fa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d40f50a0 0x7f78d40fa370 secure :-1 s=READY pgs=307 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78c4006fd0 tx=0x7f78c400cc00 comp rx=0 tx=0).stop 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 shutdown_connections 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f78d40f50a0 0x7f78d40fa370 unknown :-1 s=CLOSED pgs=307 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f78d4115270 0x7f78d4175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f78a80b5680 0x7f78a80d5b30 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 --2- 10.20.193.28:0/463515299 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f78d410f060 0x7f78d40f4a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 >> 10.20.193.28:0/463515299 conn(0x7f78d40ec980 msgr2=0x7f78d4113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 shutdown_connections 2026-02-13T01:29:22.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:22.781+0000 7f78d3fff6c0 1 -- 10.20.193.28:0/463515299 wait complete. 2026-02-13T01:29:22.844 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:22 trial028 ceph-mon[22984]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:23.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:22 trial134 ceph-mon[27948]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:22 trial187 ceph-mon[27464]: pgmap v317: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:24.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:23 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/463515299' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:24.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:23 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/463515299' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:24.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:23 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/463515299' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:25.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:24 trial134 ceph-mon[27948]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:24 trial187 ceph-mon[27464]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:25.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:24 trial028 ceph-mon[22984]: pgmap v318: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:25.888 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:26.073 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:26.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 -- 10.20.193.28:0/4087630429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3081149c0 msgr2=0x7fe308114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/4087630429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3081149c0 0x7fe308114ee0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=10527762276624182086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f800aa40 tx=0x7fe2f802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 -- 10.20.193.28:0/4087630429 shutdown_connections 2026-02-13T01:29:26.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/4087630429 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe308113dc0 0x7fe308114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/4087630429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3081149c0 0x7fe308114ee0 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=10527762276624182086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/4087630429 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe30811b510 0x7fe30811b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 -- 10.20.193.28:0/4087630429 >> 10.20.193.28:0/4087630429 conn(0x7fe308058a50 msgr2=0x7fe308058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:26.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 -- 10.20.193.28:0/4087630429 shutdown_connections 2026-02-13T01:29:26.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.277+0000 7fe30d8746c0 1 -- 10.20.193.28:0/4087630429 wait complete. 2026-02-13T01:29:26.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 Processor -- start 2026-02-13T01:29:26.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 -- start start 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 0x7fe30812b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe3081149c0 0x7fe30812bd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30811b510 0x7fe3081310f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe308131740 con 0x7fe308113dc0 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe3081318b0 con 0x7fe3081149c0 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.278+0000 7fe30d8746c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe308131a70 con 0x7fe30811b510 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 0x7fe30812b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 0x7fe30812b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58628/0 (socket says 10.20.193.28:58628) 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 -- 10.20.193.28:0/3201639266 learned_addr learned my addr 10.20.193.28:0/3201639266 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe3067fc6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe3081149c0 0x7fe30812bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe3077fe6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30811b510 0x7fe3081310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 -- 10.20.193.28:0/3201639266 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30811b510 msgr2=0x7fe3081310f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30811b510 0x7fe3081310f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 -- 10.20.193.28:0/3201639266 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe3081149c0 msgr2=0x7fe30812bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe3081149c0 0x7fe30812bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 -- 10.20.193.28:0/3201639266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f800a660 con 0x7fe308113dc0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe306ffd6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 0x7fe30812b7f0 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2fc00b710 tx=0x7fe2fc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2fc004250 con 0x7fe308113dc0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe2fc009070 con 0x7fe308113dc0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe308131d50 con 0x7fe308113dc0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2fc00cd70 con 0x7fe308113dc0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.279+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe308172430 con 0x7fe308113dc0 2026-02-13T01:29:26.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.280+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30805b000 con 0x7fe308113dc0 2026-02-13T01:29:26.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.283+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fe2fc0028c0 con 0x7fe308113dc0 2026-02-13T01:29:26.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.285+0000 7fe30c86e6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2dc0b5680 0x7fe2dc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.285+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fe2fc0e3ae0 con 0x7fe308113dc0 2026-02-13T01:29:26.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.285+0000 7fe3067fc6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2dc0b5680 0x7fe2dc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.285+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe2fc11c5e0 con 0x7fe308113dc0 2026-02-13T01:29:26.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.285+0000 7fe3067fc6c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2dc0b5680 0x7fe2dc0d5b30 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f0005980 tx=0x7fe2f0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:26.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.409+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe308114ee0 con 0x7fe308113dc0 2026-02-13T01:29:26.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.409+0000 7fe30c86e6c0 1 -- 10.20.193.28:0/3201639266 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe2fc0a6510 con 0x7fe308113dc0 2026-02-13T01:29:26.410 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:26.410 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:26.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2dc0b5680 msgr2=0x7fe2dc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2dc0b5680 0x7fe2dc0d5b30 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2f0005980 tx=0x7fe2f0005910 comp rx=0 tx=0).stop 2026-02-13T01:29:26.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 msgr2=0x7fe30812b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 0x7fe30812b7f0 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2fc00b710 tx=0x7fe2fc00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 shutdown_connections 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe2dc0b5680 0x7fe2dc0d5b30 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fe30811b510 0x7fe3081310f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fe3081149c0 0x7fe30812bd30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 --2- 10.20.193.28:0/3201639266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe308113dc0 0x7fe30812b7f0 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 >> 10.20.193.28:0/3201639266 conn(0x7fe308058a50 msgr2=0x7fe308119450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 shutdown_connections 2026-02-13T01:29:26.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:26.411+0000 7fe30d8746c0 1 -- 10.20.193.28:0/3201639266 wait complete. 2026-02-13T01:29:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:26 trial134 ceph-mon[27948]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:27.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:26 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3201639266' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:26 trial187 ceph-mon[27464]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:26 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3201639266' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:27.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:26 trial028 ceph-mon[22984]: pgmap v319: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:27.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:26 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3201639266' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:29.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:28 trial134 ceph-mon[27948]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:29.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:28 trial187 ceph-mon[27464]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:29.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:28 trial028 ceph-mon[22984]: pgmap v320: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:29.515 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:29.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 -- 10.20.193.28:0/4284010935 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9880115410 msgr2=0x7f9880175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 --2- 10.20.193.28:0/4284010935 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9880115410 0x7f9880175db0 secure :-1 s=READY pgs=110 gs=3 cs=0 l=1 c_cookie=8935853320207262104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f987000a9b0 tx=0x7f987002fd20 comp rx=0 tx=0).stop 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 -- 10.20.193.28:0/4284010935 shutdown_connections 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 --2- 10.20.193.28:0/4284010935 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f9880115410 0x7f9880175db0 unknown :-1 s=CLOSED pgs=110 gs=3 cs=0 l=1 c_cookie=8935853320207262104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 --2- 10.20.193.28:0/4284010935 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f988010fbf0 0x7f9880114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 --2- 10.20.193.28:0/4284010935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f988010f200 0x7f988010f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 -- 10.20.193.28:0/4284010935 >> 10.20.193.28:0/4284010935 conn(0x7f98800ecb00 msgr2=0x7f988010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 -- 10.20.193.28:0/4284010935 shutdown_connections 2026-02-13T01:29:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.896+0000 7f9885a886c0 1 -- 10.20.193.28:0/4284010935 wait complete. 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 Processor -- start 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 -- start start 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 0x7f98800f9080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9880115410 0x7f9880175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f98800f96b0 0x7f98800fe980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f98800f9da0 con 0x7f9880115410 2026-02-13T01:29:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98800feec0 con 0x7f98800f96b0 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f9885a886c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f98800ff080 con 0x7f988010f200 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f987effd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 0x7f98800f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f987f7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f98800f96b0 0x7f98800fe980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f987f7fe6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f98800f96b0 0x7f98800fe980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:54478/0 (socket says 10.20.193.28:54478) 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f987f7fe6c0 1 -- 10.20.193.28:0/1729367000 learned_addr learned my addr 10.20.193.28:0/1729367000 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f987effd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 0x7f98800f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:49850/0 (socket says 10.20.193.28:49850) 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.897+0000 7f987e7fc6c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9880115410 0x7f9880175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f987effd6c0 1 -- 10.20.193.28:0/1729367000 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f98800f96b0 msgr2=0x7f98800fe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f987effd6c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f98800f96b0 0x7f98800fe980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f987effd6c0 1 -- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9880115410 msgr2=0x7f9880175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f987effd6c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9880115410 0x7f9880175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f987effd6c0 1 -- 10.20.193.28:0/1729367000 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987000a5b0 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f987effd6c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 0x7f98800f9080 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f987400b710 tx=0x7f987400bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9874004a80 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9874009030 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98800ff360 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98800ffaf0 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f987400cdd0 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.898+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98801104d0 con 0x7f988010f200 2026-02-13T01:29:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.900+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9874004c70 con 0x7f988010f200 2026-02-13T01:29:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.902+0000 7f9884a866c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5600 0x7f98540d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.902+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f98740e3940 con 0x7f988010f200 2026-02-13T01:29:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.902+0000 7f987e7fc6c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5600 0x7f98540d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.902+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f98740e3dc0 con 0x7f988010f200 2026-02-13T01:29:29.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:29.903+0000 7f987e7fc6c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5600 0x7f98540d5ab0 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98800ffa10 tx=0x7f9868009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:30.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.026+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f988010f600 con 0x7f988010f200 2026-02-13T01:29:30.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.027+0000 7f9884a866c0 1 -- 10.20.193.28:0/1729367000 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f98740a6370 con 0x7f988010f200 2026-02-13T01:29:30.027 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:30.027 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5600 msgr2=0x7f98540d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5600 0x7f98540d5ab0 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98800ffa10 tx=0x7f9868009310 comp rx=0 tx=0).stop 2026-02-13T01:29:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 msgr2=0x7f98800f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 0x7f98800f9080 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f987400b710 tx=0x7f987400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:29:30.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 shutdown_connections 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f98800f96b0 0x7f98800fe980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9880115410 0x7f9880175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f98540b5600 0x7f98540d5ab0 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 --2- 10.20.193.28:0/1729367000 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f988010f200 0x7f98800f9080 unknown :-1 s=CLOSED pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 >> 10.20.193.28:0/1729367000 conn(0x7f98800ecb00 msgr2=0x7f988010da00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 shutdown_connections 2026-02-13T01:29:30.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:30.028+0000 7f9885a886c0 1 -- 10.20.193.28:0/1729367000 wait complete. 2026-02-13T01:29:31.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:30 trial134 ceph-mon[27948]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:31.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:30 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1729367000' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:30 trial187 ceph-mon[27464]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:30 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1729367000' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:30 trial028 ceph-mon[22984]: pgmap v321: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:31.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:30 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1729367000' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:33.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:32 trial134 ceph-mon[27948]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:33.129 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:32 trial187 ceph-mon[27464]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:33.181 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:32 trial028 ceph-mon[22984]: pgmap v322: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:33.314 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.507+0000 7f872491f6c0 1 -- 10.20.193.28:0/1116732320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872010fa50 msgr2=0x7f8720114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.507+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1116732320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872010fa50 0x7f8720114a90 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=4678734169464904851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87100099a0 tx=0x7f871002ed00 comp rx=0 tx=0).stop 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.507+0000 7f872491f6c0 1 -- 10.20.193.28:0/1116732320 shutdown_connections 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.507+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1116732320 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8720115270 0x7f8720175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.507+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1116732320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f872010fa50 0x7f8720114a90 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=4678734169464904851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.507+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1116732320 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 0x7f872010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.508+0000 7f872491f6c0 1 -- 10.20.193.28:0/1116732320 >> 10.20.193.28:0/1116732320 conn(0x7f87200ec980 msgr2=0x7f872010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:33.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.508+0000 7f872491f6c0 1 -- 10.20.193.28:0/1116732320 shutdown_connections 2026-02-13T01:29:33.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.508+0000 7f872491f6c0 1 -- 10.20.193.28:0/1116732320 wait complete. 2026-02-13T01:29:33.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 Processor -- start 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 -- start start 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 0x7f87200f4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8720115270 0x7f8720175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 0x7f87200fa360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f87200f57d0 con 0x7f87200f50e0 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87200fa8a0 con 0x7f872010f060 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f872491f6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f87200faa60 con 0x7f8720115270 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f871ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 0x7f87200fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f871ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 0x7f87200fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58668/0 (socket says 10.20.193.28:58668) 2026-02-13T01:29:33.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f871ffff6c0 1 -- 10.20.193.28:0/1462823638 learned_addr learned my addr 10.20.193.28:0/1462823638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.509+0000 7f871f7fe6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 0x7f87200f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871ffff6c0 1 -- 10.20.193.28:0/1462823638 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8720115270 msgr2=0x7f8720175b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871ffff6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8720115270 0x7f8720175b10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871ffff6c0 1 -- 10.20.193.28:0/1462823638 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 msgr2=0x7f87200f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871ffff6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 0x7f87200f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871ffff6c0 1 -- 10.20.193.28:0/1462823638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8710009590 con 0x7f87200f50e0 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871f7fe6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 0x7f87200f4ab0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871ffff6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 0x7f87200fa360 secure :-1 s=READY pgs=311 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8714006ea0 tx=0x7f871400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8714003a30 con 0x7f87200f50e0 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8714005510 con 0x7f87200f50e0 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f871400dd70 con 0x7f87200f50e0 2026-02-13T01:29:33.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87200fad40 con 0x7f87200f50e0 2026-02-13T01:29:33.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87200fb1d0 con 0x7f87200f50e0 2026-02-13T01:29:33.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.510+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8720110330 con 0x7f87200f50e0 2026-02-13T01:29:33.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.513+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f8714003b90 con 0x7f87200f50e0 2026-02-13T01:29:33.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.515+0000 7f871cff96c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f86f40b5680 0x7f86f40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.515+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f87140e4920 con 0x7f87200f50e0 2026-02-13T01:29:33.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.515+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f87140e4da0 con 0x7f87200f50e0 2026-02-13T01:29:33.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.515+0000 7f871f7fe6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f86f40b5680 0x7f86f40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.515+0000 7f871f7fe6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f86f40b5680 0x7f86f40d5b30 secure :-1 s=READY pgs=276 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f870c004750 tx=0x7f870c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:33.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.642+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f87200fb1d0 con 0x7f87200f50e0 2026-02-13T01:29:33.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.642+0000 7f871cff96c0 1 -- 10.20.193.28:0/1462823638 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f87140a7350 con 0x7f87200f50e0 2026-02-13T01:29:33.643 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:33.643 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.643+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f86f40b5680 msgr2=0x7f86f40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.643+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f86f40b5680 0x7f86f40d5b30 secure :-1 s=READY pgs=276 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f870c004750 tx=0x7f870c009260 comp rx=0 tx=0).stop 2026-02-13T01:29:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.643+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 msgr2=0x7f87200fa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.643+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 0x7f87200fa360 secure :-1 s=READY pgs=311 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8714006ea0 tx=0x7f871400cca0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 shutdown_connections 2026-02-13T01:29:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f86f40b5680 0x7f86f40d5b30 unknown :-1 s=CLOSED pgs=276 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8720115270 0x7f8720175b10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87200f50e0 0x7f87200fa360 unknown :-1 s=CLOSED pgs=311 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 --2- 10.20.193.28:0/1462823638 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f872010f060 0x7f87200f4ab0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 >> 10.20.193.28:0/1462823638 conn(0x7f87200ec980 msgr2=0x7f872010d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 shutdown_connections 2026-02-13T01:29:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:33.644+0000 7f872491f6c0 1 -- 10.20.193.28:0/1462823638 wait complete. 2026-02-13T01:29:34.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:33 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1462823638' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:34.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:33 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1462823638' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:34.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:33 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1462823638' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:35.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:34 trial134 ceph-mon[27948]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:34 trial187 ceph-mon[27464]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:35.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:34 trial028 ceph-mon[22984]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:29:36.750 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:36.936 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:37.035 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:36 trial028 ceph-mon[22984]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:37.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:36 trial134 ceph-mon[27948]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/111701357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec115270 msgr2=0x7fa6ec175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:37.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/111701357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec115270 0x7fa6ec175c10 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=6489313519172172028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6dc00aa70 tx=0x7fa6dc02fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/111701357 shutdown_connections 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/111701357 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa6ec10fa50 0x7fa6ec114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/111701357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec115270 0x7fa6ec175c10 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=6489313519172172028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/111701357 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa6ec10f060 0x7fa6ec10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/111701357 >> 10.20.193.28:0/111701357 conn(0x7fa6ec0ec980 msgr2=0x7fa6ec10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/111701357 shutdown_connections 2026-02-13T01:29:37.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.131+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/111701357 wait complete. 2026-02-13T01:29:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 Processor -- start 2026-02-13T01:29:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 -- start start 2026-02-13T01:29:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa6ec10f060 0x7fa6ec11cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa6ec115270 0x7fa6ec11d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 0x7fa6ec122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:37.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec123240 con 0x7fa6ec122860 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec1233b0 con 0x7fa6ec115270 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ebfff6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec123570 con 0x7fa6ec10f060 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6eb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 0x7fa6ec122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6eb7fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 0x7fa6ec122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46500/0 (socket says 10.20.193.28:46500) 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6eb7fe6c0 1 -- 10.20.193.28:0/2865595288 learned_addr learned my addr 10.20.193.28:0/2865595288 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6eaffd6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa6ec10f060 0x7fa6ec11cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6ea7fc6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa6ec115270 0x7fa6ec11d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.132+0000 7fa6eb7fe6c0 1 -- 10.20.193.28:0/2865595288 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa6ec10f060 msgr2=0x7fa6ec11cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6eb7fe6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa6ec10f060 0x7fa6ec11cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6eb7fe6c0 1 -- 10.20.193.28:0/2865595288 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa6ec115270 msgr2=0x7fa6ec11d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:37.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6eb7fe6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa6ec115270 0x7fa6ec11d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6eb7fe6c0 1 -- 10.20.193.28:0/2865595288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc00a660 con 0x7fa6ec122860 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6eb7fe6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 0x7fa6ec122d00 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6dc030af0 tx=0x7fa6dc0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6dc003a30 con 0x7fa6ec122860 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa6dc003b90 con 0x7fa6ec122860 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ec1639f0 con 0x7fa6ec122860 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6dc038410 con 0x7fa6ec122860 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ec163e20 con 0x7fa6ec122860 2026-02-13T01:29:37.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.133+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ec110330 con 0x7fa6ec122860 2026-02-13T01:29:37.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.136+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fa6dc003d00 con 0x7fa6ec122860 2026-02-13T01:29:37.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.137+0000 7fa6cbfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6c00b5600 0x7fa6c00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:37.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.138+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fa6dc108f20 con 0x7fa6ec122860 2026-02-13T01:29:37.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.138+0000 7fa6eaffd6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6c00b5600 0x7fa6c00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:37.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.138+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa6dc1093a0 con 0x7fa6ec122860 2026-02-13T01:29:37.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.138+0000 7fa6eaffd6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6c00b5600 0x7fa6c00d5ab0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6e0005980 tx=0x7fa6e0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:37.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:36 trial187 ceph-mon[27464]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-13T01:29:37.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.264+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6ec10f430 con 0x7fa6ec122860 2026-02-13T01:29:37.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.264+0000 7fa6cbfff6c0 1 -- 10.20.193.28:0/2865595288 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa6dc0cb950 con 0x7fa6ec122860 2026-02-13T01:29:37.265 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:37.265 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6c00b5600 msgr2=0x7fa6c00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6c00b5600 0x7fa6c00d5ab0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6e0005980 tx=0x7fa6e0005910 comp rx=0 tx=0).stop 2026-02-13T01:29:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 msgr2=0x7fa6ec122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 0x7fa6ec122d00 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6dc030af0 tx=0x7fa6dc0054b0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 shutdown_connections 2026-02-13T01:29:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6ec122860 0x7fa6ec122d00 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa6ec115270 0x7fa6ec11d4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa6c00b5600 0x7fa6c00d5ab0 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 --2- 10.20.193.28:0/2865595288 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa6ec10f060 0x7fa6ec11cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 >> 10.20.193.28:0/2865595288 conn(0x7fa6ec0ec980 msgr2=0x7fa6ec10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 shutdown_connections 2026-02-13T01:29:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:37.265+0000 7fa6ebfff6c0 1 -- 10.20.193.28:0/2865595288 wait complete. 2026-02-13T01:29:38.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:37 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2865595288' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:38.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:37 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2865595288' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:38.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:37 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2865595288' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:39.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:38 trial134 ceph-mon[27948]: pgmap v325: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:39.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:38 trial187 ceph-mon[27464]: pgmap v325: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:39.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:38 trial028 ceph-mon[22984]: pgmap v325: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-13T01:29:40.368 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:40.553 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 -- 10.20.193.28:0/3383054934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 msgr2=0x7fee2c17a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 --2- 10.20.193.28:0/3383054934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c17a2c0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=17382407335922838777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee2800aa40 tx=0x7fee2802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 -- 10.20.193.28:0/3383054934 shutdown_connections 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 --2- 10.20.193.28:0/3383054934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c17a2c0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=17382407335922838777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 --2- 10.20.193.28:0/3383054934 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fee2c114190 0x7fee2c119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 --2- 10.20.193.28:0/3383054934 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fee2c1137a0 0x7fee2c113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 -- 10.20.193.28:0/3383054934 >> 10.20.193.28:0/3383054934 conn(0x7fee2c060760 msgr2=0x7fee2c060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 -- 10.20.193.28:0/3383054934 shutdown_connections 2026-02-13T01:29:40.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.751+0000 7fee341356c0 1 -- 10.20.193.28:0/3383054934 wait complete. 2026-02-13T01:29:40.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 Processor -- start 2026-02-13T01:29:40.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 -- start start 2026-02-13T01:29:40.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fee2c1137a0 0x7fee2c1215c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:40.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c121b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:40.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fee2c126ec0 0x7fee2c127360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:40.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1278d0 con 0x7fee2c1198f0 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c127a40 con 0x7fee2c1137a0 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.752+0000 7fee341356c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c127c00 con 0x7fee2c126ec0 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c121b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46530/0 (socket says 10.20.193.28:46530) 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 -- 10.20.193.28:0/159959702 learned_addr learned my addr 10.20.193.28:0/159959702 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee326a76c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fee2c126ec0 0x7fee2c127360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee31ea66c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fee2c1137a0 0x7fee2c1215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 -- 10.20.193.28:0/159959702 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fee2c126ec0 msgr2=0x7fee2c127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fee2c126ec0 0x7fee2c127360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 -- 10.20.193.28:0/159959702 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fee2c1137a0 msgr2=0x7fee2c1215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fee2c1137a0 0x7fee2c1215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 -- 10.20.193.28:0/159959702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2800a660 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee316a56c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c121b00 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee200092e0 tx=0x7fee2000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee20004250 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee200043b0 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee2000cde0 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c1680b0 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.753+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c168540 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.754+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2c1149e0 con 0x7fee2c1198f0 2026-02-13T01:29:40.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.756+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fee200026b0 con 0x7fee2c1198f0 2026-02-13T01:29:40.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.758+0000 7fee1affd6c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fee080b5680 0x7fee080d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:40.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.758+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fee200e3a00 con 0x7fee2c1198f0 2026-02-13T01:29:40.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.758+0000 7fee31ea66c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fee080b5680 0x7fee080d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:40.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.758+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fee2011c5e0 con 0x7fee2c1198f0 2026-02-13T01:29:40.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.758+0000 7fee31ea66c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fee080b5680 0x7fee080d5b30 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c005980 tx=0x7fee1c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:40.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.882+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fee2c113b70 con 0x7fee2c1198f0 2026-02-13T01:29:40.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.882+0000 7fee1affd6c0 1 -- 10.20.193.28:0/159959702 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fee200a6470 con 0x7fee2c1198f0 2026-02-13T01:29:40.883 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:40.883 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fee080b5680 msgr2=0x7fee080d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fee080b5680 0x7fee080d5b30 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1c005980 tx=0x7fee1c005910 comp rx=0 tx=0).stop 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 msgr2=0x7fee2c121b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c121b00 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee200092e0 tx=0x7fee2000bc50 comp rx=0 tx=0).stop 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 shutdown_connections 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fee080b5680 0x7fee080d5b30 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fee2c126ec0 0x7fee2c127360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c1198f0 0x7fee2c121b00 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 --2- 10.20.193.28:0/159959702 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fee2c1137a0 0x7fee2c1215c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 >> 10.20.193.28:0/159959702 conn(0x7fee2c060760 msgr2=0x7fee2c1167b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:40.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.883+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 shutdown_connections 2026-02-13T01:29:40.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:40.884+0000 7fee341356c0 1 -- 10.20.193.28:0/159959702 wait complete. 2026-02-13T01:29:40.944 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:40 trial028 ceph-mon[22984]: pgmap v326: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:41.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:40 trial134 ceph-mon[27948]: pgmap v326: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:40 trial187 ceph-mon[27464]: pgmap v326: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:29:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:41 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/159959702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:42.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:41 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:42.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:41 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/159959702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:42.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:41 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:41 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/159959702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:42.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:41 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: pgmap v327: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:43.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:42 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:43.073 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: pgmap v327: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:43.074 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:43.074 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:43.074 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:29:43.074 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:43.074 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:43.074 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:42 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: pgmap v327: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:42 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:43.985 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:44.037 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:43 trial028 ceph-mon[22984]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:29:44.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:43 trial134 ceph-mon[27948]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:29:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:43 trial187 ceph-mon[27464]: pgmap v328: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:29:44.169 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:44.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/3032738380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c1415bb40 msgr2=0x7f1c1417bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:44.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/3032738380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c1415bb40 0x7f1c1417bf80 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=10654103887990297113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c0400aa40 tx=0x7f1c0402fdf0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/3032738380 shutdown_connections 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/3032738380 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1c14114300 0x7f1c14114710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/3032738380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c1415bb40 0x7f1c1417bf80 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=10654103887990297113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/3032738380 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1c14115320 0x7f1c14113dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/3032738380 >> 10.20.193.28:0/3032738380 conn(0x7f1c1405b290 msgr2=0x7f1c1405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/3032738380 shutdown_connections 2026-02-13T01:29:44.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.366+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/3032738380 wait complete. 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 Processor -- start 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 -- start start 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 0x7f1c14103700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1c14115320 0x7f1c14103c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1c1415bb40 0x7f1c14108fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c14109600 con 0x7f1c14114300 2026-02-13T01:29:44.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1c14109770 con 0x7f1c14115320 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c1880b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1c14109930 con 0x7f1c1415bb40 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 0x7f1c14103700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 0x7f1c14103700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46560/0 (socket says 10.20.193.28:46560) 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 -- 10.20.193.28:0/1044379602 learned_addr learned my addr 10.20.193.28:0/1044379602 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c135776c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1c1415bb40 0x7f1c14108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c125756c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1c14115320 0x7f1c14103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 -- 10.20.193.28:0/1044379602 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1c1415bb40 msgr2=0x7f1c14108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1c1415bb40 0x7f1c14108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 -- 10.20.193.28:0/1044379602 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1c14115320 msgr2=0x7f1c14103c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1c14115320 0x7f1c14103c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.367+0000 7f1c12d766c0 1 -- 10.20.193.28:0/1044379602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0400a660 con 0x7f1c14114300 2026-02-13T01:29:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.368+0000 7f1c12d766c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 0x7f1c14103700 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c08009490 tx=0x7f1c0800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.368+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c08004a80 con 0x7f1c14114300 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.368+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1c08009030 con 0x7f1c14114300 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.368+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c080071c0 con 0x7f1c14114300 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.368+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c14109c10 con 0x7f1c14114300 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.368+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c14155990 con 0x7f1c14114300 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.369+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1405e670 con 0x7f1c14114300 2026-02-13T01:29:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.371+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1c08004060 con 0x7f1c14114300 2026-02-13T01:29:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.372+0000 7f1bf3fff6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1be40b5680 0x7f1be40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.373+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f1c080e3a10 con 0x7f1c14114300 2026-02-13T01:29:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.373+0000 7f1c125756c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1be40b5680 0x7f1be40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.373+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1c0811c5e0 con 0x7f1c14114300 2026-02-13T01:29:44.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.373+0000 7f1c125756c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1be40b5680 0x7f1be40d5b30 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c1410a040 tx=0x7f1bfc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:44.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.498+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1c14104800 con 0x7f1c14114300 2026-02-13T01:29:44.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.498+0000 7f1bf3fff6c0 1 -- 10.20.193.28:0/1044379602 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1c080a6440 con 0x7f1c14114300 2026-02-13T01:29:44.498 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:44.499 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:44.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1be40b5680 msgr2=0x7f1be40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1be40b5680 0x7f1be40d5b30 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c1410a040 tx=0x7f1bfc009260 comp rx=0 tx=0).stop 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 msgr2=0x7f1c14103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 0x7f1c14103700 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c08009490 tx=0x7f1c0800bca0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 shutdown_connections 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f1be40b5680 0x7f1be40d5b30 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f1c1415bb40 0x7f1c14108fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f1c14115320 0x7f1c14103c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 --2- 10.20.193.28:0/1044379602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c14114300 0x7f1c14103700 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 >> 10.20.193.28:0/1044379602 conn(0x7f1c1405b290 msgr2=0x7f1c140f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:44.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 shutdown_connections 2026-02-13T01:29:44.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:44.499+0000 7f1c1880b6c0 1 -- 10.20.193.28:0/1044379602 wait complete. 2026-02-13T01:29:44.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:44 trial028 ceph-mon[22984]: pgmap v329: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:44.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:44 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1044379602' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:45.051 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:44 trial134 ceph-mon[27948]: pgmap v329: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:45.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:44 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1044379602' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:44 trial187 ceph-mon[27464]: pgmap v329: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:45.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:44 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1044379602' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:47.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:46 trial134 ceph-mon[27948]: pgmap v330: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:29:47.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:46 trial187 ceph-mon[27464]: pgmap v330: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:29:47.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:46 trial028 ceph-mon[22984]: pgmap v330: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:29:47.607 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:47.793 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 -- 10.20.193.28:0/289208278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f735410fa50 msgr2=0x7f7354114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 --2- 10.20.193.28:0/289208278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f735410fa50 0x7f7354114a90 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=5792051902899571929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73440099a0 tx=0x7f734402ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 -- 10.20.193.28:0/289208278 shutdown_connections 2026-02-13T01:29:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 --2- 10.20.193.28:0/289208278 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7354115270 0x7f7354175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 --2- 10.20.193.28:0/289208278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f735410fa50 0x7f7354114a90 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=5792051902899571929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 --2- 10.20.193.28:0/289208278 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f735410f060 0x7f735410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 -- 10.20.193.28:0/289208278 >> 10.20.193.28:0/289208278 conn(0x7f73540ec980 msgr2=0x7f735410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 -- 10.20.193.28:0/289208278 shutdown_connections 2026-02-13T01:29:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:47.999+0000 7f735955a6c0 1 -- 10.20.193.28:0/289208278 wait complete. 2026-02-13T01:29:48.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.000+0000 7f735955a6c0 1 Processor -- start 2026-02-13T01:29:48.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.000+0000 7f735955a6c0 1 -- start start 2026-02-13T01:29:48.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f735955a6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 0x7f73540f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:48.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f735955a6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7354115270 0x7f7354175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:48.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f735955a6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f73540f4ff0 0x7f73540fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f735955a6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f73540f56e0 con 0x7f7354115270 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f735955a6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73540fa7b0 con 0x7f73540f4ff0 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f735955a6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f73540fa970 con 0x7f735410f060 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 0x7f73540f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 0x7f73540f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:59070/0 (socket says 10.20.193.28:59070) 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 -- 10.20.193.28:0/1380734171 learned_addr learned my addr 10.20.193.28:0/1380734171 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f73537fe6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7354115270 0x7f7354175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7358d596c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f73540f4ff0 0x7f73540fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 -- 10.20.193.28:0/1380734171 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f73540f4ff0 msgr2=0x7f73540fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f73540f4ff0 0x7f73540fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 -- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7354115270 msgr2=0x7f7354175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7354115270 0x7f7354175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 -- 10.20.193.28:0/1380734171 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73400094c0 con 0x7f735410f060 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.001+0000 7f7353fff6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 0x7f73540f49c0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f734000ba60 tx=0x7f734000bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.002+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73400044a0 con 0x7f735410f060 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.002+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7344009590 con 0x7f735410f060 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.002+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73540faff0 con 0x7f735410f060 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.002+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7340009030 con 0x7f735410f060 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.002+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73400071c0 con 0x7f735410f060 2026-02-13T01:29:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.002+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7354110330 con 0x7f735410f060 2026-02-13T01:29:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.005+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f73400026b0 con 0x7f735410f060 2026-02-13T01:29:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.006+0000 7f73517fa6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f73280b5600 0x7f73280d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:48.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.006+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f73400e3c70 con 0x7f735410f060 2026-02-13T01:29:48.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.006+0000 7f73537fe6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f73280b5600 0x7f73280d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:48.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.007+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f73400e40f0 con 0x7f735410f060 2026-02-13T01:29:48.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.007+0000 7f73537fe6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f73280b5600 0x7f73280d5ab0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73440023e0 tx=0x7f7344031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:48.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.131+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f735410f430 con 0x7f735410f060 2026-02-13T01:29:48.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.131+0000 7f73517fa6c0 1 -- 10.20.193.28:0/1380734171 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f73400a66a0 con 0x7f735410f060 2026-02-13T01:29:48.132 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:48.132 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f73280b5600 msgr2=0x7f73280d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f73280b5600 0x7f73280d5ab0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73440023e0 tx=0x7f7344031f90 comp rx=0 tx=0).stop 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 msgr2=0x7f73540f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 0x7f73540f49c0 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f734000ba60 tx=0x7f734000bf30 comp rx=0 tx=0).stop 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 shutdown_connections 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f73540f4ff0 0x7f73540fa270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7354115270 0x7f7354175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f73280b5600 0x7f73280d5ab0 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 --2- 10.20.193.28:0/1380734171 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f735410f060 0x7f73540f49c0 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:48.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 >> 10.20.193.28:0/1380734171 conn(0x7f73540ec980 msgr2=0x7f735410d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:48.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 shutdown_connections 2026-02-13T01:29:48.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:48.132+0000 7f735955a6c0 1 -- 10.20.193.28:0/1380734171 wait complete. 2026-02-13T01:29:49.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:48 trial134 ceph-mon[27948]: pgmap v331: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:49.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:48 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1380734171' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:49.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:48 trial187 ceph-mon[27464]: pgmap v331: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:49.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:48 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1380734171' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:48 trial028 ceph-mon[22984]: pgmap v331: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:49.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:48 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1380734171' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:51.052 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:50 trial134 ceph-mon[27948]: pgmap v332: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:51.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:50 trial187 ceph-mon[27464]: pgmap v332: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:51.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:50 trial028 ceph-mon[22984]: pgmap v332: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:51.237 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:51.421 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:51.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3930242978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d081198f0 msgr2=0x7f3d0817a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:51.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3930242978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d081198f0 0x7f3d0817a2c0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=8447338134703514628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cfc00aa40 tx=0x7f3cfc02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3930242978 shutdown_connections 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3930242978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d081198f0 0x7f3d0817a2c0 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=8447338134703514628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3930242978 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d08114190 0x7f3d08119140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3930242978 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3d081137a0 0x7f3d08113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3930242978 >> 10.20.193.28:0/3930242978 conn(0x7f3d08060760 msgr2=0x7f3d08060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3930242978 shutdown_connections 2026-02-13T01:29:51.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3930242978 wait complete. 2026-02-13T01:29:51.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.616+0000 7f3d108b86c0 1 Processor -- start 2026-02-13T01:29:51.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 -- start start 2026-02-13T01:29:51.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d081137a0 0x7f3d08121640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:51.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3d081198f0 0x7f3d08121b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d08126f40 0x7f3d081273e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08127950 con 0x7f3d08126f40 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08127ac0 con 0x7f3d081137a0 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d108b86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08127c80 con 0x7f3d081198f0 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0e62d6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d081137a0 0x7f3d08121640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d08126f40 0x7f3d081273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0de2c6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3d081198f0 0x7f3d08121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0e62d6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d081137a0 0x7f3d08121640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:58034/0 (socket says 10.20.193.28:58034) 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0e62d6c0 1 -- 10.20.193.28:0/3070130506 learned_addr learned my addr 10.20.193.28:0/3070130506 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 -- 10.20.193.28:0/3070130506 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3d081198f0 msgr2=0x7f3d08121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:51.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3d081198f0 0x7f3d08121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 -- 10.20.193.28:0/3070130506 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d081137a0 msgr2=0x7f3d08121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d081137a0 0x7f3d08121640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 -- 10.20.193.28:0/3070130506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc00a660 con 0x7f3d08126f40 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.617+0000 7f3d0ee2e6c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d08126f40 0x7f3d081273e0 secure :-1 s=READY pgs=320 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cfc030300 tx=0x7f3cfc0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.618+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cfc030d80 con 0x7f3d08126f40 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.618+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3cfc0309c0 con 0x7f3d08126f40 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.618+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3cfc032a20 con 0x7f3d08126f40 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.618+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d081680d0 con 0x7f3d08126f40 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.618+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d08168500 con 0x7f3d08126f40 2026-02-13T01:29:51.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.618+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d081149e0 con 0x7f3d08126f40 2026-02-13T01:29:51.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.621+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f3cfc003810 con 0x7f3d08126f40 2026-02-13T01:29:51.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.622+0000 7f3cf37fe6c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ce40b5700 0x7f3ce40d5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:51.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.622+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f3cfc108cb0 con 0x7f3d08126f40 2026-02-13T01:29:51.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.623+0000 7f3d0e62d6c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ce40b5700 0x7f3ce40d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:51.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.623+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3cfc1090b0 con 0x7f3d08126f40 2026-02-13T01:29:51.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.623+0000 7f3d0e62d6c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ce40b5700 0x7f3ce40d5bb0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d00009260 tx=0x7f3d00009440 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:51.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.747+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d08113b70 con 0x7f3d08126f40 2026-02-13T01:29:51.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.747+0000 7f3cf37fe6c0 1 -- 10.20.193.28:0/3070130506 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3cfc0cb6e0 con 0x7f3d08126f40 2026-02-13T01:29:51.748 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:51.748 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:51.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.748+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ce40b5700 msgr2=0x7f3ce40d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:51.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.748+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ce40b5700 0x7f3ce40d5bb0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d00009260 tx=0x7f3d00009440 comp rx=0 tx=0).stop 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.748+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d08126f40 msgr2=0x7f3d081273e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.748+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d08126f40 0x7f3d081273e0 secure :-1 s=READY pgs=320 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cfc030300 tx=0x7f3cfc0054b0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 shutdown_connections 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ce40b5700 0x7f3ce40d5bb0 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3d081198f0 0x7f3d08121b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d08126f40 0x7f3d081273e0 unknown :-1 s=CLOSED pgs=320 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 --2- 10.20.193.28:0/3070130506 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3d081137a0 0x7f3d08121640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 >> 10.20.193.28:0/3070130506 conn(0x7f3d08060760 msgr2=0x7f3d08116f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 shutdown_connections 2026-02-13T01:29:51.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:51.749+0000 7f3d108b86c0 1 -- 10.20.193.28:0/3070130506 wait complete. 2026-02-13T01:29:51.803 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:51 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3070130506' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:52.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:51 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3070130506' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:52.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:51 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3070130506' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:53.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:52 trial187 ceph-mon[27464]: pgmap v333: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:53.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:52 trial028 ceph-mon[22984]: pgmap v333: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:53.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:52 trial134 ceph-mon[27948]: pgmap v333: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:29:54.850 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:55.034 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:55.077 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:54 trial028 ceph-mon[22984]: pgmap v334: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 7 op/s 2026-02-13T01:29:55.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:54 trial187 ceph-mon[27464]: pgmap v334: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 7 op/s 2026-02-13T01:29:55.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 -- 10.20.193.28:0/2918010070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff630113dc0 msgr2=0x7ff630114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:55.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/2918010070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff630113dc0 0x7ff630114210 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=11237996618861593470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff620009970 tx=0x7ff62002ed10 comp rx=0 tx=0).stop 2026-02-13T01:29:55.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 -- 10.20.193.28:0/2918010070 shutdown_connections 2026-02-13T01:29:55.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/2918010070 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff6301149c0 0x7ff630114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/2918010070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff630113dc0 0x7ff630114210 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=11237996618861593470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/2918010070 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff63011b510 0x7ff63011b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 -- 10.20.193.28:0/2918010070 >> 10.20.193.28:0/2918010070 conn(0x7ff630058a50 msgr2=0x7ff630058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 -- 10.20.193.28:0/2918010070 shutdown_connections 2026-02-13T01:29:55.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.224+0000 7ff63609b6c0 1 -- 10.20.193.28:0/2918010070 wait complete. 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 Processor -- start 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 -- start start 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff630113dc0 0x7ff63012b880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6301149c0 0x7ff63012bdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 0x7ff630131130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff630131780 con 0x7ff63011b510 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301318f0 con 0x7ff630113dc0 2026-02-13T01:29:55.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff63609b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff630131ab0 con 0x7ff6301149c0 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 0x7ff630131130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 0x7ff630131130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54226/0 (socket says 10.20.193.28:54226) 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 -- 10.20.193.28:0/3959713949 learned_addr learned my addr 10.20.193.28:0/3959713949 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62effd6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6301149c0 0x7ff63012bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62f7fe6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff630113dc0 0x7ff63012b880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 -- 10.20.193.28:0/3959713949 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6301149c0 msgr2=0x7ff63012bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6301149c0 0x7ff63012bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 -- 10.20.193.28:0/3959713949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff630113dc0 msgr2=0x7ff63012b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff630113dc0 0x7ff63012b880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.225+0000 7ff62ffff6c0 1 -- 10.20.193.28:0/3959713949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff620009590 con 0x7ff63011b510 2026-02-13T01:29:55.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff62ffff6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 0x7ff630131130 secure :-1 s=READY pgs=322 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff624006a60 tx=0x7ff62400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff624003c40 con 0x7ff63011b510 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff62400a070 con 0x7ff63011b510 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff62400de20 con 0x7ff63011b510 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff630131d90 con 0x7ff63011b510 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff630172470 con 0x7ff63011b510 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.226+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff630131fb0 con 0x7ff63011b510 2026-02-13T01:29:55.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.229+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ff624005030 con 0x7ff63011b510 2026-02-13T01:29:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.231+0000 7ff62cff96c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff6040b5680 0x7ff6040d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.231+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7ff6240e4a30 con 0x7ff63011b510 2026-02-13T01:29:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.231+0000 7ff62f7fe6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff6040b5680 0x7ff6040d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.231+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff62411d5e0 con 0x7ff63011b510 2026-02-13T01:29:55.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.231+0000 7ff62f7fe6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff6040b5680 0x7ff6040d5b30 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff61c005fd0 tx=0x7ff61c005d10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:55.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:54 trial134 ceph-mon[27948]: pgmap v334: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 7 op/s 2026-02-13T01:29:55.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.354+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff63005b000 con 0x7ff63011b510 2026-02-13T01:29:55.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.355+0000 7ff62cff96c0 1 -- 10.20.193.28:0/3959713949 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff6240a7460 con 0x7ff63011b510 2026-02-13T01:29:55.355 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:55.356 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff6040b5680 msgr2=0x7ff6040d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff6040b5680 0x7ff6040d5b30 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff61c005fd0 tx=0x7ff61c005d10 comp rx=0 tx=0).stop 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 msgr2=0x7ff630131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 0x7ff630131130 secure :-1 s=READY pgs=322 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff624006a60 tx=0x7ff62400cca0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 shutdown_connections 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff6040b5680 0x7ff6040d5b30 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff6301149c0 0x7ff63012bdc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff63011b510 0x7ff630131130 unknown :-1 s=CLOSED pgs=322 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 --2- 10.20.193.28:0/3959713949 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff630113dc0 0x7ff63012b880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:55.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.356+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 >> 10.20.193.28:0/3959713949 conn(0x7ff630058a50 msgr2=0x7ff630119450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:55.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.357+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 shutdown_connections 2026-02-13T01:29:55.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:55.357+0000 7ff63609b6c0 1 -- 10.20.193.28:0/3959713949 wait complete. 2026-02-13T01:29:56.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:55 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3959713949' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:56.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:55 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3959713949' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:56.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:55 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3959713949' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:57.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:56 trial187 ceph-mon[27464]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:29:57.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:56 trial028 ceph-mon[22984]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:29:57.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:56 trial134 ceph-mon[27948]: pgmap v335: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:29:58.459 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:58.643 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:29:58.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.846+0000 7f71f24136c0 1 -- 10.20.193.28:0/3072219349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10f060 msgr2=0x7f71ec10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:58.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.846+0000 7f71f24136c0 1 --2- 10.20.193.28:0/3072219349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10f060 0x7f71ec10f430 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=2948864005015075622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71dc0099a0 tx=0x7f71dc02ed00 comp rx=0 tx=0).stop 2026-02-13T01:29:58.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 -- 10.20.193.28:0/3072219349 shutdown_connections 2026-02-13T01:29:58.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 --2- 10.20.193.28:0/3072219349 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71ec115270 0x7f71ec175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 --2- 10.20.193.28:0/3072219349 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f71ec10fa50 0x7f71ec114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 --2- 10.20.193.28:0/3072219349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10f060 0x7f71ec10f430 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=2948864005015075622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 -- 10.20.193.28:0/3072219349 >> 10.20.193.28:0/3072219349 conn(0x7f71ec0ec980 msgr2=0x7f71ec10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 -- 10.20.193.28:0/3072219349 shutdown_connections 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 -- 10.20.193.28:0/3072219349 wait complete. 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 Processor -- start 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.847+0000 7f71f24136c0 1 -- start start 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f24136c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71ec10f060 0x7f71ec11cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f24136c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f71ec115270 0x7f71ec11d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f24136c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 0x7f71ec122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:58.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f24136c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec123240 con 0x7f71ec122830 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f24136c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec1233b0 con 0x7f71ec115270 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f24136c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec123570 con 0x7f71ec10f060 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 0x7f71ec122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f14116c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71ec10f060 0x7f71ec11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 0x7f71ec122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44634/0 (socket says 10.20.193.28:44634) 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 -- 10.20.193.28:0/1167693363 learned_addr learned my addr 10.20.193.28:0/1167693363 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f0c106c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f71ec115270 0x7f71ec11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 -- 10.20.193.28:0/1167693363 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71ec10f060 msgr2=0x7f71ec11cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71ec10f060 0x7f71ec11cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 -- 10.20.193.28:0/1167693363 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f71ec115270 msgr2=0x7f71ec11d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:58.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f71ec115270 0x7f71ec11d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 -- 10.20.193.28:0/1167693363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc009590 con 0x7f71ec122830 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71f1c126c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 0x7f71ec122cd0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71e8006ea0 tx=0x7f71e800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.848+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71e8003c40 con 0x7f71ec122830 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.849+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec163a20 con 0x7f71ec122830 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.849+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71e8003da0 con 0x7f71ec122830 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.849+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71e80081c0 con 0x7f71ec122830 2026-02-13T01:29:58.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.849+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec163eb0 con 0x7f71ec122830 2026-02-13T01:29:58.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.849+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec110330 con 0x7f71ec122830 2026-02-13T01:29:58.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.852+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f71e800d590 con 0x7f71ec122830 2026-02-13T01:29:58.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.854+0000 7f71da7fc6c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f71c80b5600 0x7f71c80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:58.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.854+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f71e80e4ad0 con 0x7f71ec122830 2026-02-13T01:29:58.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.854+0000 7f71f14116c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f71c80b5600 0x7f71c80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:58.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.854+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f71e811d5e0 con 0x7f71ec122830 2026-02-13T01:29:58.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.854+0000 7f71f14116c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f71c80b5600 0x7f71c80d5ab0 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71dc031fd0 tx=0x7f71dc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.978+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f71ec11e080 con 0x7f71ec122830 2026-02-13T01:29:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.978+0000 7f71da7fc6c0 1 -- 10.20.193.28:0/1167693363 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f71e80a7540 con 0x7f71ec122830 2026-02-13T01:29:58.979 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:29:58.979 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f71c80b5600 msgr2=0x7f71c80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f71c80b5600 0x7f71c80d5ab0 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71dc031fd0 tx=0x7f71dc0023a0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 msgr2=0x7f71ec122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 0x7f71ec122cd0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71e8006ea0 tx=0x7f71e800ce50 comp rx=0 tx=0).stop 2026-02-13T01:29:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 shutdown_connections 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec122830 0x7f71ec122cd0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f71ec115270 0x7f71ec11d470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f71c80b5600 0x7f71c80d5ab0 unknown :-1 s=CLOSED pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 --2- 10.20.193.28:0/1167693363 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71ec10f060 0x7f71ec11cf30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 >> 10.20.193.28:0/1167693363 conn(0x7f71ec0ec980 msgr2=0x7f71ec10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 shutdown_connections 2026-02-13T01:29:58.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:29:58.979+0000 7f71f24136c0 1 -- 10.20.193.28:0/1167693363 wait complete. 2026-02-13T01:29:59.024 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:58 trial028 ceph-mon[22984]: pgmap v336: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:59.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:58 trial187 ceph-mon[27464]: pgmap v336: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:29:59.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:58 trial134 ceph-mon[27948]: pgmap v336: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:00.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:29:59 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1167693363' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:00.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:29:59 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1167693363' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:00.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:29:59 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1167693363' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial187 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplli89zey:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5qqh3snv:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T01:30:01.144 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T01:30:01.145 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: Traceback (most recent call last): 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: return _run_code(code, main_globals, None, 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: exec(code, run_globals) 2026-02-13T01:30:01.146 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T01:30:01.147 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:00 trial187 ceph-mon[27464]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial187 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplli89zey:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5qqh3snv:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial187 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplli89zey:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5qqh3snv:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T01:30:01.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T01:30:01.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: Traceback (most recent call last): 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: return _run_code(code, main_globals, None, 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: exec(code, run_globals) 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T01:30:01.199 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T01:30:01.200 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T01:30:01.200 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:00 trial028 ceph-mon[22984]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial187 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplli89zey:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5qqh3snv:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:01.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: pgmap v337: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:01.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T01:30:01.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.c/config 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial187 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplli89zey:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5qqh3snv:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T01:30:01.303 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T01:30:01.304 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: Traceback (most recent call last): 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: return _run_code(code, main_globals, None, 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: exec(code, run_globals) 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T01:30:01.305 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T01:30:01.306 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T01:30:01.306 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: File "/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T01:30:01.306 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:00 trial134 ceph-mon[27948]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial187 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplli89zey:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5qqh3snv:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:02.083 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:02.270 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:02.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 -- 10.20.193.28:0/2222648794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810fa50 msgr2=0x7f7158114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 --2- 10.20.193.28:0/2222648794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810fa50 0x7f7158114a90 secure :-1 s=READY pgs=325 gs=3 cs=0 l=1 c_cookie=12685155553520648721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71480098d0 tx=0x7f714802ec30 comp rx=0 tx=0).stop 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 -- 10.20.193.28:0/2222648794 shutdown_connections 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 --2- 10.20.193.28:0/2222648794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7158115270 0x7f7158175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 --2- 10.20.193.28:0/2222648794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810fa50 0x7f7158114a90 unknown :-1 s=CLOSED pgs=325 gs=3 cs=0 l=1 c_cookie=12685155553520648721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 --2- 10.20.193.28:0/2222648794 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f715810f060 0x7f715810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 -- 10.20.193.28:0/2222648794 >> 10.20.193.28:0/2222648794 conn(0x7f71580ec980 msgr2=0x7f715810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 -- 10.20.193.28:0/2222648794 shutdown_connections 2026-02-13T01:30:02.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.466+0000 7f715cdd46c0 1 -- 10.20.193.28:0/2222648794 wait complete. 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 Processor -- start 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 -- start start 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 0x7f71580f4a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7158115270 0x7f7158175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71580f50a0 0x7f71580fa370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71580f5790 con 0x7f715810f060 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71580fa8b0 con 0x7f7158115270 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f715cdd46c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f71580faa70 con 0x7f71580f50a0 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f71577fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 0x7f71580f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:02.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f71577fe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 0x7f71580f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44650/0 (socket says 10.20.193.28:44650) 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f71577fe6c0 1 -- 10.20.193.28:0/1300433193 learned_addr learned my addr 10.20.193.28:0/1300433193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.467+0000 7f7157fff6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71580f50a0 0x7f71580fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f7156ffd6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7158115270 0x7f7158175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f71577fe6c0 1 -- 10.20.193.28:0/1300433193 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71580f50a0 msgr2=0x7f71580fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f71577fe6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71580f50a0 0x7f71580fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f71577fe6c0 1 -- 10.20.193.28:0/1300433193 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7158115270 msgr2=0x7f7158175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f71577fe6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7158115270 0x7f7158175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f71577fe6c0 1 -- 10.20.193.28:0/1300433193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71480094c0 con 0x7f715810f060 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f71577fe6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 0x7f71580f4a70 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7144005950 tx=0x7f714400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7144004460 con 0x7f715810f060 2026-02-13T01:30:02.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71440045c0 con 0x7f715810f060 2026-02-13T01:30:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7144003960 con 0x7f715810f060 2026-02-13T01:30:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f715cdd46c0 1 -- 10.20.193.28:0/1300433193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71580fad50 con 0x7f715810f060 2026-02-13T01:30:02.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.468+0000 7f715cdd46c0 1 -- 10.20.193.28:0/1300433193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71580fb4e0 con 0x7f715810f060 2026-02-13T01:30:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.469+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7158110330 con 0x7f715810f060 2026-02-13T01:30:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.471+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f71440050b0 con 0x7f715810f060 2026-02-13T01:30:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.472+0000 7f7154ff96c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f712c0b5680 0x7f712c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.472+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f71440e39c0 con 0x7f715810f060 2026-02-13T01:30:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.473+0000 7f7156ffd6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f712c0b5680 0x7f712c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:02.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.473+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f71440e3e40 con 0x7f715810f060 2026-02-13T01:30:02.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.473+0000 7f7156ffd6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f712c0b5680 0x7f712c0d5b30 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71480097f0 tx=0x7f71480023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.597+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f71580f5bc0 con 0x7f715810f060 2026-02-13T01:30:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.598+0000 7f7154ff96c0 1 -- 10.20.193.28:0/1300433193 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f71440a63f0 con 0x7f715810f060 2026-02-13T01:30:02.599 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:02.599 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:02.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f712c0b5680 msgr2=0x7f712c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f712c0b5680 0x7f712c0d5b30 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71480097f0 tx=0x7f71480023a0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 msgr2=0x7f71580f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 0x7f71580f4a70 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7144005950 tx=0x7f714400bca0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 shutdown_connections 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f712c0b5680 0x7f712c0d5b30 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f71580f50a0 0x7f71580fa370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7158115270 0x7f7158175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 --2- 10.20.193.28:0/1300433193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f715810f060 0x7f71580f4a70 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:02.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 >> 10.20.193.28:0/1300433193 conn(0x7f71580ec980 msgr2=0x7f7158113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 shutdown_connections 2026-02-13T01:30:02.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:02.599+0000 7f71327fc6c0 1 -- 10.20.193.28:0/1300433193 wait complete. 2026-02-13T01:30:02.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:02 trial028 ceph-mon[22984]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:02.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:02 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1300433193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:03.104 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:02 trial134 ceph-mon[27948]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:03.104 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:02 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1300433193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:02 trial187 ceph-mon[27464]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:03.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:02 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1300433193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:05.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:04 trial187 ceph-mon[27464]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:05.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:04 trial028 ceph-mon[22984]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:05.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:04 trial134 ceph-mon[27948]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:05.738 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:05.924 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:06.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.116+0000 7fea1f5776c0 1 -- 10.20.193.28:0/3315410293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea2010cde0 msgr2=0x7fea2010d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:06.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.116+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/3315410293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea2010cde0 0x7fea2010d1b0 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=8660355276001029070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea140099a0 tx=0x7fea1402ed50 comp rx=0 tx=0).stop 2026-02-13T01:30:06.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 -- 10.20.193.28:0/3315410293 shutdown_connections 2026-02-13T01:30:06.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/3315410293 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010d7d0 0x7fea20112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/3315410293 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea20112ff0 0x7fea20173990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/3315410293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea2010cde0 0x7fea2010d1b0 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=8660355276001029070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 -- 10.20.193.28:0/3315410293 >> 10.20.193.28:0/3315410293 conn(0x7fea200ea6a0 msgr2=0x7fea2010aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:06.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 -- 10.20.193.28:0/3315410293 shutdown_connections 2026-02-13T01:30:06.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 -- 10.20.193.28:0/3315410293 wait complete. 2026-02-13T01:30:06.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.117+0000 7fea1f5776c0 1 Processor -- start 2026-02-13T01:30:06.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 -- start start 2026-02-13T01:30:06.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010cde0 0x7fea200f49b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea20112ff0 0x7fea20173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 0x7fea200fa2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea200f56d0 con 0x7fea20112ff0 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fea200fa7f0 con 0x7fea200f4fe0 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1f5776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fea200fa9b0 con 0x7fea2010cde0 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1dd746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea20112ff0 0x7fea20173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1ed766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 0x7fea200fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1dd746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea20112ff0 0x7fea20173890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43892/0 (socket says 10.20.193.28:43892) 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1ed766c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 0x7fea200fa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:56870/0 (socket says 10.20.193.28:56870) 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1ed766c0 1 -- 10.20.193.28:0/776977081 learned_addr learned my addr 10.20.193.28:0/776977081 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:06.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.118+0000 7fea1e5756c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010cde0 0x7fea200f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1ed766c0 1 -- 10.20.193.28:0/776977081 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010cde0 msgr2=0x7fea200f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1ed766c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010cde0 0x7fea200f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1ed766c0 1 -- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea20112ff0 msgr2=0x7fea20173890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1ed766c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea20112ff0 0x7fea20173890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1ed766c0 1 -- 10.20.193.28:0/776977081 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea14009590 con 0x7fea200f4fe0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1e5756c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010cde0 0x7fea200f49b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1ed766c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 0x7fea200fa2b0 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea1000c9b0 tx=0x7fea1000ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea10003c40 con 0x7fea200f4fe0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea200fac90 con 0x7fea200f4fe0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea10003da0 con 0x7fea200f4fe0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea100081c0 con 0x7fea200f4fe0 2026-02-13T01:30:06.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.119+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea200fb120 con 0x7fea200f4fe0 2026-02-13T01:30:06.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.120+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2010e0b0 con 0x7fea200f4fe0 2026-02-13T01:30:06.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.122+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fea1000d5c0 con 0x7fea200f4fe0 2026-02-13T01:30:06.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.124+0000 7fea077fe6c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9f80b5600 0x7fe9f80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:06.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.124+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fea100e48c0 con 0x7fea200f4fe0 2026-02-13T01:30:06.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.124+0000 7fea1e5756c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9f80b5600 0x7fe9f80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:06.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.124+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fea100e4d40 con 0x7fea200f4fe0 2026-02-13T01:30:06.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.124+0000 7fea1e5756c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9f80b5600 0x7fe9f80d5ab0 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea1402f960 tx=0x7fea140023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:06.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.247+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fea200fb120 con 0x7fea200f4fe0 2026-02-13T01:30:06.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.247+0000 7fea077fe6c0 1 -- 10.20.193.28:0/776977081 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fea100a72f0 con 0x7fea200f4fe0 2026-02-13T01:30:06.249 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:06.249 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9f80b5600 msgr2=0x7fe9f80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9f80b5600 0x7fe9f80d5ab0 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea1402f960 tx=0x7fea140023a0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 msgr2=0x7fea200fa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 0x7fea200fa2b0 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea1000c9b0 tx=0x7fea1000ce80 comp rx=0 tx=0).stop 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 shutdown_connections 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fea200f4fe0 0x7fea200fa2b0 unknown :-1 s=CLOSED pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea20112ff0 0x7fea20173890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fe9f80b5600 0x7fe9f80d5ab0 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 --2- 10.20.193.28:0/776977081 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fea2010cde0 0x7fea200f49b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:06.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 >> 10.20.193.28:0/776977081 conn(0x7fea200ea6a0 msgr2=0x7fea2010e910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:06.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 shutdown_connections 2026-02-13T01:30:06.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:06.248+0000 7fea1f5776c0 1 -- 10.20.193.28:0/776977081 wait complete. 2026-02-13T01:30:07.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:06 trial187 ceph-mon[27464]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:07.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:06 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/776977081' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:06 trial028 ceph-mon[22984]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:07.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:06 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/776977081' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:07.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:06 trial134 ceph-mon[27948]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:07.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:06 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/776977081' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:09.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:08 trial187 ceph-mon[27464]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:09.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:08 trial028 ceph-mon[22984]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:09.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:08 trial134 ceph-mon[27948]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:09.352 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:09.538 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:09.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 -- 10.20.193.28:0/4116238476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c115270 msgr2=0x7f099c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:09.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/4116238476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c115270 0x7f099c175c10 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=4212570170824843113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f098c00aa70 tx=0x7f098c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 -- 10.20.193.28:0/4116238476 shutdown_connections 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/4116238476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c115270 0x7f099c175c10 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=4212570170824843113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/4116238476 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f099c10fa50 0x7f099c114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/4116238476 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f099c10f060 0x7f099c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 -- 10.20.193.28:0/4116238476 >> 10.20.193.28:0/4116238476 conn(0x7f099c0ec980 msgr2=0x7f099c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 -- 10.20.193.28:0/4116238476 shutdown_connections 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.733+0000 7f09a081b6c0 1 -- 10.20.193.28:0/4116238476 wait complete. 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 Processor -- start 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 -- start start 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 0x7f099c11cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:09.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f099c115270 0x7f099c11d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:09.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f099c122860 0x7f099c122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:09.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f099c123270 con 0x7f099c10f060 2026-02-13T01:30:09.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1233e0 con 0x7f099c122860 2026-02-13T01:30:09.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f09a081b6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1235a0 con 0x7f099c115270 2026-02-13T01:30:09.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099ad766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 0x7f099c11cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:09.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099ad766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 0x7f099c11cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43898/0 (socket says 10.20.193.28:43898) 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099ad766c0 1 -- 10.20.193.28:0/3340395176 learned_addr learned my addr 10.20.193.28:0/3340395176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099a5756c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f099c115270 0x7f099c11d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099b5776c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f099c122860 0x7f099c122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099ad766c0 1 -- 10.20.193.28:0/3340395176 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f099c115270 msgr2=0x7f099c11d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.734+0000 7f099ad766c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f099c115270 0x7f099c11d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f099ad766c0 1 -- 10.20.193.28:0/3340395176 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f099c122860 msgr2=0x7f099c122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f099ad766c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f099c122860 0x7f099c122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f099ad766c0 1 -- 10.20.193.28:0/3340395176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098c00a660 con 0x7f099c10f060 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f099ad766c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 0x7f099c11cf60 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0990005dc0 tx=0x7f0990009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0990012c70 con 0x7f099c10f060 2026-02-13T01:30:09.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0990012dd0 con 0x7f099c10f060 2026-02-13T01:30:09.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09900071c0 con 0x7f099c10f060 2026-02-13T01:30:09.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c0628d0 con 0x7f099c10f060 2026-02-13T01:30:09.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c062d60 con 0x7f099c10f060 2026-02-13T01:30:09.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.735+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c110330 con 0x7f099c10f060 2026-02-13T01:30:09.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.738+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f09900026b0 con 0x7f099c10f060 2026-02-13T01:30:09.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.739+0000 7f097bfff6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f09700b5600 0x7f09700d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:09.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.740+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f09900ec5a0 con 0x7f099c10f060 2026-02-13T01:30:09.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.740+0000 7f099a5756c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f09700b5600 0x7f09700d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:09.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.740+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f09900eca20 con 0x7f099c10f060 2026-02-13T01:30:09.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.740+0000 7f099a5756c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f09700b5600 0x7f09700d5ab0 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c1238f0 tx=0x7f0984009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:09.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.863+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f099c10f430 con 0x7f099c10f060 2026-02-13T01:30:09.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.863+0000 7f097bfff6c0 1 -- 10.20.193.28:0/3340395176 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f09900aefd0 con 0x7f099c10f060 2026-02-13T01:30:09.864 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:09.864 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:09.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f09700b5600 msgr2=0x7f09700d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:09.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f09700b5600 0x7f09700d5ab0 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c1238f0 tx=0x7f0984009390 comp rx=0 tx=0).stop 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 msgr2=0x7f099c11cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 0x7f099c11cf60 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0990005dc0 tx=0x7f0990009f50 comp rx=0 tx=0).stop 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 shutdown_connections 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f09700b5600 0x7f09700d5ab0 unknown :-1 s=CLOSED pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f099c115270 0x7f099c11d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f099c122860 0x7f099c122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 --2- 10.20.193.28:0/3340395176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f099c10f060 0x7f099c11cf60 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 >> 10.20.193.28:0/3340395176 conn(0x7f099c0ec980 msgr2=0x7f099c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 shutdown_connections 2026-02-13T01:30:09.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:09.865+0000 7f09a081b6c0 1 -- 10.20.193.28:0/3340395176 wait complete. 2026-02-13T01:30:11.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:10 trial187 ceph-mon[27464]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:11.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:10 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3340395176' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:10 trial028 ceph-mon[22984]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:11.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:10 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3340395176' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:11.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:10 trial134 ceph-mon[27948]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:11.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:10 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3340395176' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:12.969 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:13.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:12 trial187 ceph-mon[27464]: pgmap v343: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:13.153 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:13.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:12 trial028 ceph-mon[22984]: pgmap v343: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:13.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:12 trial134 ceph-mon[27948]: pgmap v343: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 -- 10.20.193.28:0/2956758433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410fa50 msgr2=0x7fceb4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/2956758433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410fa50 0x7fceb4114a90 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=11722983338713300841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcea80099a0 tx=0x7fcea802ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 -- 10.20.193.28:0/2956758433 shutdown_connections 2026-02-13T01:30:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/2956758433 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb4115270 0x7fceb4175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/2956758433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410fa50 0x7fceb4114a90 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=11722983338713300841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/2956758433 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fceb410f060 0x7fceb410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.356+0000 7fcebb2866c0 1 -- 10.20.193.28:0/2956758433 >> 10.20.193.28:0/2956758433 conn(0x7fceb40ec980 msgr2=0x7fceb410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.357+0000 7fcebb2866c0 1 -- 10.20.193.28:0/2956758433 shutdown_connections 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.357+0000 7fcebb2866c0 1 -- 10.20.193.28:0/2956758433 wait complete. 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.357+0000 7fcebb2866c0 1 Processor -- start 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 -- start start 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410f060 0x7fceb405e4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fceb4115270 0x7fceb4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 0x7fceb405d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fceb405d750 con 0x7fceb410f060 2026-02-13T01:30:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fceb405d8c0 con 0x7fceb405cc10 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebb2866c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fceb405da80 con 0x7fceb4115270 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 0x7fceb405d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 0x7fceb405d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:56882/0 (socket says 10.20.193.28:56882) 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 -- 10.20.193.28:0/1806832734 learned_addr learned my addr 10.20.193.28:0/1806832734 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fceb9a836c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fceb4115270 0x7fceb4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fceba2846c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410f060 0x7fceb405e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 -- 10.20.193.28:0/1806832734 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fceb4115270 msgr2=0x7fceb4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fceb4115270 0x7fceb4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 -- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410f060 msgr2=0x7fceb405e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410f060 0x7fceb405e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 -- 10.20.193.28:0/1806832734 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea8009590 con 0x7fceb405cc10 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.358+0000 7fcebaa856c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 0x7fceb405d0b0 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fceb0006ea0 tx=0x7fceb000ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.359+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fceb0003c40 con 0x7fceb405cc10 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.359+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb4107db0 con 0x7fceb405cc10 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.359+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fceb0003da0 con 0x7fceb405cc10 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.359+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fceb00081c0 con 0x7fceb405cc10 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.359+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb41082b0 con 0x7fceb405cc10 2026-02-13T01:30:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.359+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb4110330 con 0x7fceb405cc10 2026-02-13T01:30:13.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.361+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fceb000d530 con 0x7fceb405cc10 2026-02-13T01:30:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.363+0000 7fce9b7fe6c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce900b5600 0x7fce900d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.363+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fceb00e4a00 con 0x7fceb405cc10 2026-02-13T01:30:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.363+0000 7fceba2846c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce900b5600 0x7fce900d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.363+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fceb011d5e0 con 0x7fceb405cc10 2026-02-13T01:30:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.364+0000 7fceba2846c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce900b5600 0x7fce900d5ab0 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcea4004750 tx=0x7fcea4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:13.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.488+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fceb410fa50 con 0x7fceb405cc10 2026-02-13T01:30:13.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.488+0000 7fce9b7fe6c0 1 -- 10.20.193.28:0/1806832734 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fceb00a7430 con 0x7fceb405cc10 2026-02-13T01:30:13.489 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:13.489 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:13.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce900b5600 msgr2=0x7fce900d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce900b5600 0x7fce900d5ab0 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcea4004750 tx=0x7fcea4009260 comp rx=0 tx=0).stop 2026-02-13T01:30:13.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 msgr2=0x7fceb405d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 0x7fceb405d0b0 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fceb0006ea0 tx=0x7fceb000ce50 comp rx=0 tx=0).stop 2026-02-13T01:30:13.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 shutdown_connections 2026-02-13T01:30:13.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fce900b5600 0x7fce900d5ab0 unknown :-1 s=CLOSED pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fceb4115270 0x7fceb4175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fceb405cc10 0x7fceb405d0b0 unknown :-1 s=CLOSED pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 --2- 10.20.193.28:0/1806832734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fceb410f060 0x7fceb405e4d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 >> 10.20.193.28:0/1806832734 conn(0x7fceb40ec980 msgr2=0x7fceb410d780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:13.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 shutdown_connections 2026-02-13T01:30:13.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:13.489+0000 7fcebb2866c0 1 -- 10.20.193.28:0/1806832734 wait complete. 2026-02-13T01:30:13.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:13 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1806832734' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:14.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:13 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1806832734' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:14.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:13 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1806832734' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:15.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:14 trial187 ceph-mon[27464]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:15.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:14 trial028 ceph-mon[22984]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:15.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:14 trial134 ceph-mon[27948]: pgmap v344: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:16.597 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:16.783 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:16.914 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:16 trial028 ceph-mon[22984]: pgmap v345: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:16.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1263146615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea41137a0 msgr2=0x7fbea4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:16.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1263146615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea41137a0 0x7fbea4113b70 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=10704284578323633577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe900099a0 tx=0x7fbe9002ed00 comp rx=0 tx=0).stop 2026-02-13T01:30:16.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1263146615 shutdown_connections 2026-02-13T01:30:16.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1263146615 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbea4116520 0x7fbea417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:16.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1263146615 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbea4114190 0x7fbea4115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:16.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1263146615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea41137a0 0x7fbea4113b70 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=10704284578323633577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.975+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1263146615 >> 10.20.193.28:0/1263146615 conn(0x7fbea4061510 msgr2=0x7fbea4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.976+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1263146615 shutdown_connections 2026-02-13T01:30:16.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.976+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1263146615 wait complete. 2026-02-13T01:30:16.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.976+0000 7fbea8df76c0 1 Processor -- start 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.976+0000 7fbea8df76c0 1 -- start start 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea8df76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbea41137a0 0x7fbea41215a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea8df76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbea4116520 0x7fbea4121ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea8df76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 0x7fbea41272f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea8df76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbea4127860 con 0x7fbea4126e50 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea8df76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbea41279d0 con 0x7fbea41137a0 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea8df76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbea4127b90 con 0x7fbea4116520 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 0x7fbea41272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 0x7fbea41272f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59888/0 (socket says 10.20.193.28:59888) 2026-02-13T01:30:16.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 -- 10.20.193.28:0/1444313235 learned_addr learned my addr 10.20.193.28:0/1444313235 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea37fe6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbea41137a0 0x7fbea41215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea2ffd6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbea4116520 0x7fbea4121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 -- 10.20.193.28:0/1444313235 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbea4116520 msgr2=0x7fbea4121ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbea4116520 0x7fbea4121ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 -- 10.20.193.28:0/1444313235 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbea41137a0 msgr2=0x7fbea41215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbea41137a0 0x7fbea41215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 -- 10.20.193.28:0/1444313235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe90009590 con 0x7fbea4126e50 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.977+0000 7fbea3fff6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 0x7fbea41272f0 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe98006ea0 tx=0x7fbe9800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.978+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe98003c40 con 0x7fbea4126e50 2026-02-13T01:30:16.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.978+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe98003da0 con 0x7fbea4126e50 2026-02-13T01:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.978+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe980081c0 con 0x7fbea4126e50 2026-02-13T01:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.978+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea4168040 con 0x7fbea4126e50 2026-02-13T01:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.978+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea41684d0 con 0x7fbea4126e50 2026-02-13T01:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.978+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea4114840 con 0x7fbea4126e50 2026-02-13T01:30:16.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.981+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fbe9800d590 con 0x7fbea4126e50 2026-02-13T01:30:16.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.982+0000 7fbea0ff96c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbe780b5750 0x7fbe780d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:16.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.982+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fbe980e4af0 con 0x7fbea4126e50 2026-02-13T01:30:16.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.982+0000 7fbea37fe6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbe780b5750 0x7fbe780d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:16.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.982+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbe9811d5e0 con 0x7fbea4126e50 2026-02-13T01:30:16.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:16.983+0000 7fbea37fe6c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbe780b5750 0x7fbe780d5c00 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe900023e0 tx=0x7fbe90005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:17.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.107+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbea41226a0 con 0x7fbea4126e50 2026-02-13T01:30:17.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.108+0000 7fbea0ff96c0 1 -- 10.20.193.28:0/1444313235 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbe980a7520 con 0x7fbea4126e50 2026-02-13T01:30:17.108 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:17.108 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbe780b5750 msgr2=0x7fbe780d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbe780b5750 0x7fbe780d5c00 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe900023e0 tx=0x7fbe90005c80 comp rx=0 tx=0).stop 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 msgr2=0x7fbea41272f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 0x7fbea41272f0 secure :-1 s=READY pgs=332 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe98006ea0 tx=0x7fbe9800ce50 comp rx=0 tx=0).stop 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 shutdown_connections 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fbe780b5750 0x7fbe780d5c00 unknown :-1 s=CLOSED pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fbea4116520 0x7fbea4121ae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbea4126e50 0x7fbea41272f0 unknown :-1 s=CLOSED pgs=332 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 --2- 10.20.193.28:0/1444313235 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fbea41137a0 0x7fbea41215a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 >> 10.20.193.28:0/1444313235 conn(0x7fbea4061510 msgr2=0x7fbea4116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:17.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 shutdown_connections 2026-02-13T01:30:17.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:17.109+0000 7fbea8df76c0 1 -- 10.20.193.28:0/1444313235 wait complete. 2026-02-13T01:30:17.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:16 trial187 ceph-mon[27464]: pgmap v345: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:17.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:16 trial134 ceph-mon[27948]: pgmap v345: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:18.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:17 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1444313235' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:18.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:17 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1444313235' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:18.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:17 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1444313235' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:19.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:18 trial187 ceph-mon[27464]: pgmap v346: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:19.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:18 trial028 ceph-mon[22984]: pgmap v346: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:19.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:18 trial134 ceph-mon[27948]: pgmap v346: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:20.212 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:20.396 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:20.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 -- 10.20.193.28:0/2330982359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec10f060 msgr2=0x7f85ec10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/2330982359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec10f060 0x7f85ec10f430 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=1699909930358081533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85e00098d0 tx=0x7f85e002ec30 comp rx=0 tx=0).stop 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 -- 10.20.193.28:0/2330982359 shutdown_connections 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/2330982359 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec115270 0x7f85ec175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/2330982359 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f85ec10fa50 0x7f85ec114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/2330982359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec10f060 0x7f85ec10f430 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=1699909930358081533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 -- 10.20.193.28:0/2330982359 >> 10.20.193.28:0/2330982359 conn(0x7f85ec0ec980 msgr2=0x7f85ec10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:20.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 -- 10.20.193.28:0/2330982359 shutdown_connections 2026-02-13T01:30:20.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.602+0000 7f85f09f76c0 1 -- 10.20.193.28:0/2330982359 wait complete. 2026-02-13T01:30:20.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 Processor -- start 2026-02-13T01:30:20.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 -- start start 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 0x7f85ec11cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec115270 0x7f85ec11d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f85ec122830 0x7f85ec122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec123240 con 0x7f85ec115270 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec1233b0 con 0x7f85ec122830 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.603+0000 7f85f09f76c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec123570 con 0x7f85ec10f060 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 0x7f85ec11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 0x7f85ec11cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:48752/0 (socket says 10.20.193.28:48752) 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 -- 10.20.193.28:0/1708101603 learned_addr learned my addr 10.20.193.28:0/1708101603 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85eb5776c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f85ec122830 0x7f85ec122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ea5756c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec115270 0x7f85ec11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 -- 10.20.193.28:0/1708101603 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f85ec122830 msgr2=0x7f85ec122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f85ec122830 0x7f85ec122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 -- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec115270 msgr2=0x7f85ec11d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec115270 0x7f85ec11d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 -- 10.20.193.28:0/1708101603 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e00094c0 con 0x7f85ec10f060 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85ead766c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 0x7f85ec11cf30 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85e002fb10 tx=0x7f85e002fb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85e00045f0 con 0x7f85ec10f060 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f85e002fce0 con 0x7f85ec10f060 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f85e0031030 con 0x7f85ec10f060 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec1639c0 con 0x7f85ec10f060 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.604+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec163df0 con 0x7f85ec10f060 2026-02-13T01:30:20.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.605+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ec110330 con 0x7f85ec10f060 2026-02-13T01:30:20.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.607+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f85e00071c0 con 0x7f85ec10f060 2026-02-13T01:30:20.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.609+0000 7f85cbfff6c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85c00b5600 0x7f85c00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.609+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f85e0107ae0 con 0x7f85ec10f060 2026-02-13T01:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.609+0000 7f85ea5756c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85c00b5600 0x7f85c00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.609+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f85e01405e0 con 0x7f85ec10f060 2026-02-13T01:30:20.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.610+0000 7f85ea5756c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85c00b5600 0x7f85c00d5ab0 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85ec1238c0 tx=0x7f85d4009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.734+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f85ec10f430 con 0x7f85ec10f060 2026-02-13T01:30:20.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.735+0000 7f85cbfff6c0 1 -- 10.20.193.28:0/1708101603 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f85e00ca510 con 0x7f85ec10f060 2026-02-13T01:30:20.735 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:20.736 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:20.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85c00b5600 msgr2=0x7f85c00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85c00b5600 0x7f85c00d5ab0 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85ec1238c0 tx=0x7f85d4009310 comp rx=0 tx=0).stop 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 msgr2=0x7f85ec11cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 0x7f85ec11cf30 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85e002fb10 tx=0x7f85e002fb40 comp rx=0 tx=0).stop 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 shutdown_connections 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f85ec122830 0x7f85ec122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85ec115270 0x7f85ec11d470 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f85c00b5600 0x7f85c00d5ab0 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 --2- 10.20.193.28:0/1708101603 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f85ec10f060 0x7f85ec11cf30 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 >> 10.20.193.28:0/1708101603 conn(0x7f85ec0ec980 msgr2=0x7f85ec10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:20.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 shutdown_connections 2026-02-13T01:30:20.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:20.736+0000 7f85f09f76c0 1 -- 10.20.193.28:0/1708101603 wait complete. 2026-02-13T01:30:21.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:20 trial187 ceph-mon[27464]: pgmap v347: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:21.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:20 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1708101603' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:21.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:20 trial028 ceph-mon[22984]: pgmap v347: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:21.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:20 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1708101603' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:21.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:20 trial134 ceph-mon[27948]: pgmap v347: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:21.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:20 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1708101603' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:23.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:22 trial187 ceph-mon[27464]: pgmap v348: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:23.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:22 trial028 ceph-mon[22984]: pgmap v348: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:23.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:22 trial134 ceph-mon[27948]: pgmap v348: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:23.840 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:24.024 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/1992964544 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc8115410 msgr2=0x7f0dc8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/1992964544 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc8115410 0x7f0dc8175db0 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=4096643169998754993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0dc400a9b0 tx=0x7f0dc402fd50 comp rx=0 tx=0).stop 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/1992964544 shutdown_connections 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/1992964544 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc8115410 0x7f0dc8175db0 unknown :-1 s=CLOSED pgs=114 gs=3 cs=0 l=1 c_cookie=4096643169998754993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/1992964544 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0dc810fbf0 0x7f0dc8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/1992964544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc810f200 0x7f0dc810f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/1992964544 >> 10.20.193.28:0/1992964544 conn(0x7f0dc80ecb00 msgr2=0x7f0dc810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/1992964544 shutdown_connections 2026-02-13T01:30:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.220+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/1992964544 wait complete. 2026-02-13T01:30:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 Processor -- start 2026-02-13T01:30:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 -- start start 2026-02-13T01:30:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 0x7f0dc811d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc8115410 0x7f0dc811d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0dc8122b00 0x7f0dc8122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8123510 con 0x7f0dc8115410 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8123680 con 0x7f0dc8122b00 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dd02e86c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8123840 con 0x7f0dc810f200 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dce05d6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 0x7f0dc811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dce05d6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 0x7f0dc811d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:48774/0 (socket says 10.20.193.28:48774) 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.221+0000 7f0dce05d6c0 1 -- 10.20.193.28:0/2320869187 learned_addr learned my addr 10.20.193.28:0/2320869187 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc8115410 0x7f0dc811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dce85e6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0dc8122b00 0x7f0dc8122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:24.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 -- 10.20.193.28:0/2320869187 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 msgr2=0x7f0dc811d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 0x7f0dc811d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 -- 10.20.193.28:0/2320869187 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0dc8122b00 msgr2=0x7f0dc8122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0dc8122b00 0x7f0dc8122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 -- 10.20.193.28:0/2320869187 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc400a5b0 con 0x7f0dc8115410 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dce05d6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 0x7f0dc811d200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dcd85c6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc8115410 0x7f0dc811d740 secure :-1 s=READY pgs=334 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0dbc004750 tx=0x7f0dbc00bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0dbc004240 con 0x7f0dc8115410 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0dbc009030 con 0x7f0dc8115410 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0dbc0036e0 con 0x7f0dc8115410 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.222+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc8163cf0 con 0x7f0dc8115410 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.223+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc8164180 con 0x7f0dc8115410 2026-02-13T01:30:24.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.223+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc81104d0 con 0x7f0dc8115410 2026-02-13T01:30:24.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.225+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f0dbc0038b0 con 0x7f0dc8115410 2026-02-13T01:30:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.226+0000 7f0daf7fe6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0da40b5600 0x7f0da40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.227+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f0dbc0e3aa0 con 0x7f0dc8115410 2026-02-13T01:30:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.227+0000 7f0dce05d6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0da40b5600 0x7f0da40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:24.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.227+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0dbc0a64d0 con 0x7f0dc8115410 2026-02-13T01:30:24.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.227+0000 7f0dce05d6c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0da40b5600 0x7f0da40d5ab0 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0db8005b40 tx=0x7f0db8009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:24.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.351+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0dc811e350 con 0x7f0dc8115410 2026-02-13T01:30:24.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.351+0000 7f0daf7fe6c0 1 -- 10.20.193.28:0/2320869187 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0dbc0a9680 con 0x7f0dc8115410 2026-02-13T01:30:24.352 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:24.352 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:24.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0da40b5600 msgr2=0x7f0da40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0da40b5600 0x7f0da40d5ab0 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0db8005b40 tx=0x7f0db8009310 comp rx=0 tx=0).stop 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc8115410 msgr2=0x7f0dc811d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc8115410 0x7f0dc811d740 secure :-1 s=READY pgs=334 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0dbc004750 tx=0x7f0dbc00bb60 comp rx=0 tx=0).stop 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 shutdown_connections 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f0dc8122b00 0x7f0dc8122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0dc8115410 0x7f0dc811d740 unknown :-1 s=CLOSED pgs=334 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f0da40b5600 0x7f0da40d5ab0 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 --2- 10.20.193.28:0/2320869187 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f0dc810f200 0x7f0dc811d200 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 >> 10.20.193.28:0/2320869187 conn(0x7f0dc80ecb00 msgr2=0x7f0dc810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 shutdown_connections 2026-02-13T01:30:24.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:24.353+0000 7f0dd02e86c0 1 -- 10.20.193.28:0/2320869187 wait complete. 2026-02-13T01:30:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:24 trial187 ceph-mon[27464]: pgmap v349: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:25.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:24 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2320869187' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:25.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:24 trial028 ceph-mon[22984]: pgmap v349: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:25.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:24 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2320869187' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:25.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:24 trial134 ceph-mon[27948]: pgmap v349: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:25.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:24 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2320869187' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:27.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:26 trial187 ceph-mon[27464]: pgmap v350: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:27.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:26 trial028 ceph-mon[22984]: pgmap v350: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:27.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:26 trial134 ceph-mon[27948]: pgmap v350: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:27.456 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:27.639 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:27.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2744104968 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810fa50 msgr2=0x7f7aa8114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2744104968 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810fa50 0x7f7aa8114a90 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=15715453645456159190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a980099a0 tx=0x7f7a9802ed00 comp rx=0 tx=0).stop 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2744104968 shutdown_connections 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2744104968 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810fa50 0x7f7aa8114a90 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=15715453645456159190 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2744104968 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2744104968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aa810f060 0x7f7aa810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2744104968 >> 10.20.193.28:0/2744104968 conn(0x7f7aa80ec980 msgr2=0x7f7aa810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2744104968 shutdown_connections 2026-02-13T01:30:27.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.824+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2744104968 wait complete. 2026-02-13T01:30:27.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 Processor -- start 2026-02-13T01:30:27.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 -- start start 2026-02-13T01:30:27.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810f060 0x7f7aa80f49f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aa80f5020 0x7f7aa80fa2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa80f5710 con 0x7f7aa80f5020 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa80fa830 con 0x7f7aa8115270 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aacd466c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa80fa9f0 con 0x7f7aa810f060 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aa6ffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aa77fe6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810f060 0x7f7aa80f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aa6ffd6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:47962/0 (socket says 10.20.193.28:47962) 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aa6ffd6c0 1 -- 10.20.193.28:0/2514644944 learned_addr learned my addr 10.20.193.28:0/2514644944 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.825+0000 7f7aa7fff6c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aa80f5020 0x7f7aa80fa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa6ffd6c0 1 -- 10.20.193.28:0/2514644944 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810f060 msgr2=0x7f7aa80f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa6ffd6c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810f060 0x7f7aa80f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa6ffd6c0 1 -- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aa80f5020 msgr2=0x7f7aa80fa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa6ffd6c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aa80f5020 0x7f7aa80fa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa6ffd6c0 1 -- 10.20.193.28:0/2514644944 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a98009590 con 0x7f7aa8115270 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa6ffd6c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175b10 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a98009290 tx=0x7f7a9802fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a98002ae0 con 0x7f7aa8115270 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7a980046b0 con 0x7f7aa8115270 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a980372f0 con 0x7f7aa8115270 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa80fac70 con 0x7f7aa8115270 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.826+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa80fb0a0 con 0x7f7aa8115270 2026-02-13T01:30:27.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.827+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa8110330 con 0x7f7aa8115270 2026-02-13T01:30:27.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.829+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f7a98002c40 con 0x7f7aa8115270 2026-02-13T01:30:27.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.831+0000 7f7aa4ff96c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7a7c0b5680 0x7f7a7c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.831+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f7a981079b0 con 0x7f7aa8115270 2026-02-13T01:30:27.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.831+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7a98107e30 con 0x7f7aa8115270 2026-02-13T01:30:27.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.831+0000 7f7aa77fe6c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7a7c0b5680 0x7f7a7c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.832+0000 7f7aa77fe6c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7a7c0b5680 0x7f7a7c0d5b30 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a94004750 tx=0x7f7a94009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:27.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.956+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7aa80f5b40 con 0x7f7aa8115270 2026-02-13T01:30:27.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.956+0000 7f7aa4ff96c0 1 -- 10.20.193.28:0/2514644944 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7a980ca3e0 con 0x7f7aa8115270 2026-02-13T01:30:27.956 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:27.957 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7a7c0b5680 msgr2=0x7f7a7c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7a7c0b5680 0x7f7a7c0d5b30 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a94004750 tx=0x7f7a94009260 comp rx=0 tx=0).stop 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 msgr2=0x7f7aa8175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175b10 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a98009290 tx=0x7f7a9802fc60 comp rx=0 tx=0).stop 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 shutdown_connections 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7aa80f5020 0x7f7aa80fa2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f7aa8115270 0x7f7aa8175b10 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f7a7c0b5680 0x7f7a7c0d5b30 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 --2- 10.20.193.28:0/2514644944 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f7aa810f060 0x7f7aa80f49f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 >> 10.20.193.28:0/2514644944 conn(0x7f7aa80ec980 msgr2=0x7f7aa810d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:27.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 shutdown_connections 2026-02-13T01:30:27.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:27.957+0000 7f7aacd466c0 1 -- 10.20.193.28:0/2514644944 wait complete. 2026-02-13T01:30:29.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:28 trial187 ceph-mon[27464]: pgmap v351: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:29.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:28 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2514644944' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:29.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:28 trial028 ceph-mon[22984]: pgmap v351: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:29.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:28 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2514644944' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:29.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:28 trial134 ceph-mon[27948]: pgmap v351: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:29.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:28 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2514644944' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:31.099 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:31.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:30 trial187 ceph-mon[27464]: pgmap v352: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:31.149 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:30 trial028 ceph-mon[22984]: pgmap v352: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:31.283 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:31.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:30 trial134 ceph-mon[27948]: pgmap v352: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:31.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 -- 10.20.193.28:0/2482824810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc110115270 msgr2=0x7fc110175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2482824810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc110115270 0x7fc110175c10 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=3857123051294028739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc10c00aa70 tx=0x7fc10c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 -- 10.20.193.28:0/2482824810 shutdown_connections 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2482824810 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc11010fa50 0x7fc110114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2482824810 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc110115270 0x7fc110175c10 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=3857123051294028739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2482824810 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc11010f060 0x7fc11010f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 -- 10.20.193.28:0/2482824810 >> 10.20.193.28:0/2482824810 conn(0x7fc1100ec980 msgr2=0x7fc11010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 -- 10.20.193.28:0/2482824810 shutdown_connections 2026-02-13T01:30:31.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.480+0000 7fc1159326c0 1 -- 10.20.193.28:0/2482824810 wait complete. 2026-02-13T01:30:31.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 Processor -- start 2026-02-13T01:30:31.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 -- start start 2026-02-13T01:30:31.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 0x7fc11011cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:31.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc110115270 0x7fc11011d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc110122860 0x7fc110122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc110123270 con 0x7fc11010f060 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1101233e0 con 0x7fc110115270 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1159326c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc1101235a0 con 0x7fc110122860 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1149306c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 0x7fc11011cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1149306c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 0x7fc11011cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46118/0 (socket says 10.20.193.28:46118) 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1149306c0 1 -- 10.20.193.28:0/2105049858 learned_addr learned my addr 10.20.193.28:0/2105049858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc107fff6c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc110115270 0x7fc11011d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.481+0000 7fc1151316c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc110122860 0x7fc110122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1149306c0 1 -- 10.20.193.28:0/2105049858 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc110122860 msgr2=0x7fc110122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1149306c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc110122860 0x7fc110122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1149306c0 1 -- 10.20.193.28:0/2105049858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc110115270 msgr2=0x7fc11011d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1149306c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc110115270 0x7fc11011d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1149306c0 1 -- 10.20.193.28:0/2105049858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c00a660 con 0x7fc11010f060 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1149306c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 0x7fc11011cf60 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc10000b710 tx=0x7fc10000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc100004250 con 0x7fc11010f060 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc100009070 con 0x7fc11010f060 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc10000cd70 con 0x7fc11010f060 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc110163a50 con 0x7fc11010f060 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.482+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc110163ee0 con 0x7fc11010f060 2026-02-13T01:30:31.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.483+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc110110330 con 0x7fc11010f060 2026-02-13T01:30:31.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.485+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fc1000028c0 con 0x7fc11010f060 2026-02-13T01:30:31.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.486+0000 7fc105ffb6c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc0ec0b5680 0x7fc0ec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:31.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.487+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fc1000e3ae0 con 0x7fc11010f060 2026-02-13T01:30:31.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.487+0000 7fc107fff6c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc0ec0b5680 0x7fc0ec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:31.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.487+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc10011c5e0 con 0x7fc11010f060 2026-02-13T01:30:31.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.487+0000 7fc107fff6c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc0ec0b5680 0x7fc0ec0d5b30 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1101238f0 tx=0x7fc0f8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:31.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.614+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc11010fa50 con 0x7fc11010f060 2026-02-13T01:30:31.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.614+0000 7fc105ffb6c0 1 -- 10.20.193.28:0/2105049858 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc1000a6510 con 0x7fc11010f060 2026-02-13T01:30:31.614 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:31.615 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:31.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc0ec0b5680 msgr2=0x7fc0ec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc0ec0b5680 0x7fc0ec0d5b30 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1101238f0 tx=0x7fc0f8009260 comp rx=0 tx=0).stop 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 msgr2=0x7fc11011cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 0x7fc11011cf60 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc10000b710 tx=0x7fc10000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 shutdown_connections 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fc0ec0b5680 0x7fc0ec0d5b30 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fc110122860 0x7fc110122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fc110115270 0x7fc11011d4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 --2- 10.20.193.28:0/2105049858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc11010f060 0x7fc11011cf60 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 >> 10.20.193.28:0/2105049858 conn(0x7fc1100ec980 msgr2=0x7fc11010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 shutdown_connections 2026-02-13T01:30:31.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:31.615+0000 7fc1159326c0 1 -- 10.20.193.28:0/2105049858 wait complete. 2026-02-13T01:30:31.946 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:31 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2105049858' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:32.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:31 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2105049858' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:32.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:31 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2105049858' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:33.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:32 trial187 ceph-mon[27464]: pgmap v353: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:33.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:32 trial028 ceph-mon[22984]: pgmap v353: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:33.202 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:32 trial134 ceph-mon[27948]: pgmap v353: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:34.722 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:34.908 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:35.038 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:34 trial028 ceph-mon[22984]: pgmap v354: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:35.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.098+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3792598933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd010cdd0 msgr2=0x7f8fd010d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:35.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.098+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3792598933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd010cdd0 0x7f8fd010d1a0 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=8543641415976408161 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc00099a0 tx=0x7f8fc002ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3792598933 shutdown_connections 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3792598933 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8fd010d7c0 0x7f8fd0112800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3792598933 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8fd0112fe0 0x7f8fd0173980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3792598933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd010cdd0 0x7f8fd010d1a0 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=8543641415976408161 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3792598933 >> 10.20.193.28:0/3792598933 conn(0x7f8fd00ea6d0 msgr2=0x7f8fd010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3792598933 shutdown_connections 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3792598933 wait complete. 2026-02-13T01:30:35.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 Processor -- start 2026-02-13T01:30:35.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.099+0000 7f8fd5ef66c0 1 -- start start 2026-02-13T01:30:35.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd5ef66c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8fd010cdd0 0x7f8fd00f4ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:35.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd5ef66c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8fd0112fe0 0x7f8fd0173880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd5ef66c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 0x7f8fd00fa3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd5ef66c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd00f57e0 con 0x7f8fd00f50f0 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd5ef66c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd00fa900 con 0x7f8fd010cdd0 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd5ef66c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd00faac0 con 0x7f8fd0112fe0 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 0x7f8fd00fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 0x7f8fd00fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46122/0 (socket says 10.20.193.28:46122) 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 -- 10.20.193.28:0/3610267175 learned_addr learned my addr 10.20.193.28:0/3610267175 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fc7fff6c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8fd0112fe0 0x7f8fd0173880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd4ef46c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8fd010cdd0 0x7f8fd00f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 -- 10.20.193.28:0/3610267175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8fd0112fe0 msgr2=0x7f8fd0173880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8fd0112fe0 0x7f8fd0173880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 -- 10.20.193.28:0/3610267175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8fd010cdd0 msgr2=0x7f8fd00f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8fd010cdd0 0x7f8fd00f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 -- 10.20.193.28:0/3610267175 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc0009590 con 0x7f8fd00f50f0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.100+0000 7f8fd56f56c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 0x7f8fd00fa3c0 secure :-1 s=READY pgs=338 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc006ea0 tx=0x7f8fcc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.101+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc003a30 con 0x7f8fd00f50f0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.101+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fcc005510 con 0x7f8fd00f50f0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.101+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc00dd70 con 0x7f8fd00f50f0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.101+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd00fada0 con 0x7f8fd00f50f0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.101+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd00fb530 con 0x7f8fd00f50f0 2026-02-13T01:30:35.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.101+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd010e0a0 con 0x7f8fd00f50f0 2026-02-13T01:30:35.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.104+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f8fcc003b90 con 0x7f8fd00f50f0 2026-02-13T01:30:35.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.105+0000 7f8fc5ffb6c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8fac0b5680 0x7f8fac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:35.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.105+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f8fcc0e4930 con 0x7f8fd00f50f0 2026-02-13T01:30:35.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.106+0000 7f8fd4ef46c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8fac0b5680 0x7f8fac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:35.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.106+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8fcc0e4db0 con 0x7f8fd00f50f0 2026-02-13T01:30:35.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.106+0000 7f8fd4ef46c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8fac0b5680 0x7f8fac0d5b30 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc00023e0 tx=0x7f8fc0005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:35.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:34 trial187 ceph-mon[27464]: pgmap v354: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:35.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.230+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8fd00f5c10 con 0x7f8fd00f50f0 2026-02-13T01:30:35.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.230+0000 7f8fc5ffb6c0 1 -- 10.20.193.28:0/3610267175 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8fcc0a7360 con 0x7f8fd00f50f0 2026-02-13T01:30:35.231 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:35.231 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:35.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8fac0b5680 msgr2=0x7f8fac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:35.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8fac0b5680 0x7f8fac0d5b30 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc00023e0 tx=0x7f8fc0005c80 comp rx=0 tx=0).stop 2026-02-13T01:30:35.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 msgr2=0x7f8fd00fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:35.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 0x7f8fd00fa3c0 secure :-1 s=READY pgs=338 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc006ea0 tx=0x7f8fcc00cca0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 shutdown_connections 2026-02-13T01:30:35.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f8fac0b5680 0x7f8fac0d5b30 unknown :-1 s=CLOSED pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f8fd0112fe0 0x7f8fd0173880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd00f50f0 0x7f8fd00fa3c0 unknown :-1 s=CLOSED pgs=338 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 --2- 10.20.193.28:0/3610267175 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f8fd010cdd0 0x7f8fd00f4ac0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:35.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 >> 10.20.193.28:0/3610267175 conn(0x7f8fd00ea6d0 msgr2=0x7f8fd0111720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:35.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 shutdown_connections 2026-02-13T01:30:35.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:35.231+0000 7f8fd5ef66c0 1 -- 10.20.193.28:0/3610267175 wait complete. 2026-02-13T01:30:35.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:34 trial134 ceph-mon[27948]: pgmap v354: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:36.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:35 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3610267175' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:36.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:35 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3610267175' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:36.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:35 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3610267175' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:37.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:36 trial187 ceph-mon[27464]: pgmap v355: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:37.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:36 trial028 ceph-mon[22984]: pgmap v355: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:37.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:36 trial134 ceph-mon[27948]: pgmap v355: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-13T01:30:38.337 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:38.521 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:38.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 -- 10.20.193.28:0/1142628994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c41137a0 msgr2=0x7f12c4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 --2- 10.20.193.28:0/1142628994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c41137a0 0x7f12c4113b70 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=4838115098924946581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12b00099a0 tx=0x7f12b002ed50 comp rx=0 tx=0).stop 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 -- 10.20.193.28:0/1142628994 shutdown_connections 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 --2- 10.20.193.28:0/1142628994 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4114190 0x7f12c4115d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 --2- 10.20.193.28:0/1142628994 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f12c4116520 0x7f12c417a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 --2- 10.20.193.28:0/1142628994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c41137a0 0x7f12c4113b70 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=4838115098924946581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 -- 10.20.193.28:0/1142628994 >> 10.20.193.28:0/1142628994 conn(0x7f12c4061510 msgr2=0x7f12c4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 -- 10.20.193.28:0/1142628994 shutdown_connections 2026-02-13T01:30:38.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 -- 10.20.193.28:0/1142628994 wait complete. 2026-02-13T01:30:38.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.712+0000 7f12c8e386c0 1 Processor -- start 2026-02-13T01:30:38.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 -- start start 2026-02-13T01:30:38.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f12c41137a0 0x7f12c41214f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4116520 0x7f12c4121a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c4126df0 0x7f12c4127290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4127800 con 0x7f12c4126df0 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4127970 con 0x7f12c41137a0 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c8e386c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4127b30 con 0x7f12c4116520 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c2ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4116520 0x7f12c4121a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c2ffd6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4116520 0x7f12c4121a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:45198/0 (socket says 10.20.193.28:45198) 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c2ffd6c0 1 -- 10.20.193.28:0/4268464864 learned_addr learned my addr 10.20.193.28:0/4268464864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c3fff6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c4126df0 0x7f12c4127290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c37fe6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f12c41137a0 0x7f12c41214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:38.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c3fff6c0 1 -- 10.20.193.28:0/4268464864 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4116520 msgr2=0x7f12c4121a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c3fff6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4116520 0x7f12c4121a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c3fff6c0 1 -- 10.20.193.28:0/4268464864 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f12c41137a0 msgr2=0x7f12c41214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c3fff6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f12c41137a0 0x7f12c41214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.713+0000 7f12c3fff6c0 1 -- 10.20.193.28:0/4268464864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b0009590 con 0x7f12c4126df0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f12c3fff6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c4126df0 0x7f12c4127290 secure :-1 s=READY pgs=340 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12b8006fd0 tx=0x7f12b800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12b8003c40 con 0x7f12c4126df0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f12b800a070 con 0x7f12c4126df0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12b800dd90 con 0x7f12c4126df0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f12c8e386c0 1 -- 10.20.193.28:0/4268464864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c4167fe0 con 0x7f12c4126df0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f12c8e386c0 1 -- 10.20.193.28:0/4268464864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c4168470 con 0x7f12c4126df0 2026-02-13T01:30:38.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.714+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c4114840 con 0x7f12c4126df0 2026-02-13T01:30:38.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.717+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f12b8005030 con 0x7f12c4126df0 2026-02-13T01:30:38.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.719+0000 7f12c0ff96c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f12980b57d0 0x7f12980d5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:38.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.719+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f12b80e4990 con 0x7f12c4126df0 2026-02-13T01:30:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.719+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f12b80e4d90 con 0x7f12c4126df0 2026-02-13T01:30:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.719+0000 7f12c37fe6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f12980b57d0 0x7f12980d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:38.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.720+0000 7f12c37fe6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f12980b57d0 0x7f12980d5c80 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12b00023e0 tx=0x7f12b0005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:38.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.843+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f12c4122640 con 0x7f12c4126df0 2026-02-13T01:30:38.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.844+0000 7f12c0ff96c0 1 -- 10.20.193.28:0/4268464864 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f12b80a73c0 con 0x7f12c4126df0 2026-02-13T01:30:38.844 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:38.844 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:38.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f12980b57d0 msgr2=0x7f12980d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:38.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f12980b57d0 0x7f12980d5c80 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12b00023e0 tx=0x7f12b0005c00 comp rx=0 tx=0).stop 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c4126df0 msgr2=0x7f12c4127290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c4126df0 0x7f12c4127290 secure :-1 s=READY pgs=340 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12b8006fd0 tx=0x7f12b800cc00 comp rx=0 tx=0).stop 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 shutdown_connections 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f12980b57d0 0x7f12980d5c80 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f12c4116520 0x7f12c4121a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12c4126df0 0x7f12c4127290 unknown :-1 s=CLOSED pgs=340 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 --2- 10.20.193.28:0/4268464864 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f12c41137a0 0x7f12c41214f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 >> 10.20.193.28:0/4268464864 conn(0x7f12c4061510 msgr2=0x7f12c4116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 shutdown_connections 2026-02-13T01:30:38.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:38.845+0000 7f129e7fc6c0 1 -- 10.20.193.28:0/4268464864 wait complete. 2026-02-13T01:30:38.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:38 trial028 ceph-mon[22984]: pgmap v356: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:38.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:38 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/4268464864' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:39.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:38 trial187 ceph-mon[27464]: pgmap v356: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:39.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:38 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/4268464864' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:39.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:38 trial134 ceph-mon[27948]: pgmap v356: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:39.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:38 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/4268464864' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:41.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:40 trial187 ceph-mon[27464]: pgmap v357: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:40 trial028 ceph-mon[22984]: pgmap v357: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:41.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:40 trial134 ceph-mon[27948]: pgmap v357: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T01:30:41.953 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:42.138 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 -- 10.20.193.28:0/3277430500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 msgr2=0x7f7984175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3277430500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175db0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=566099379641839444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f798000aa70 tx=0x7f798002fdd0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 -- 10.20.193.28:0/3277430500 shutdown_connections 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3277430500 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f798410fbf0 0x7f7984114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3277430500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175db0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=566099379641839444 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3277430500 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 0x7f798410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.329+0000 7f798c3186c0 1 -- 10.20.193.28:0/3277430500 >> 10.20.193.28:0/3277430500 conn(0x7f79840ecb00 msgr2=0x7f798410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.330+0000 7f798c3186c0 1 -- 10.20.193.28:0/3277430500 shutdown_connections 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.330+0000 7f798c3186c0 1 -- 10.20.193.28:0/3277430500 wait complete. 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.330+0000 7f798c3186c0 1 Processor -- start 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.330+0000 7f798c3186c0 1 -- start start 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798c3186c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 0x7f79840f4d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798c3186c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798c3186c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f79840f5340 0x7f79840fa570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798c3186c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f79840f5a30 con 0x7f7984115410 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798c3186c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79840faab0 con 0x7f798410f200 2026-02-13T01:30:42.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798c3186c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f79840fac70 con 0x7f79840f5340 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798a08d6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 0x7f79840f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798988c6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798a08d6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 0x7f79840f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:41116/0 (socket says 10.20.193.28:41116) 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798a08d6c0 1 -- 10.20.193.28:0/3981376505 learned_addr learned my addr 10.20.193.28:0/3981376505 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798a88e6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f79840f5340 0x7f79840fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798988c6c0 1 -- 10.20.193.28:0/3981376505 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f79840f5340 msgr2=0x7f79840fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798988c6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f79840f5340 0x7f79840fa570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798988c6c0 1 -- 10.20.193.28:0/3981376505 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 msgr2=0x7f79840f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798988c6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 0x7f79840f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.331+0000 7f798988c6c0 1 -- 10.20.193.28:0/3981376505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798000a660 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f798988c6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175cb0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7978004750 tx=0x7f797800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79780044a0 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7978002b90 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f797800cc70 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79840faf50 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79840fb3e0 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.332+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79841104d0 con 0x7f7984115410 2026-02-13T01:30:42.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.335+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f7978002d00 con 0x7f7984115410 2026-02-13T01:30:42.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.336+0000 7f796b7fe6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f79600b5680 0x7f79600d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:42.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.337+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f79780e34e0 con 0x7f7984115410 2026-02-13T01:30:42.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.337+0000 7f798a08d6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f79600b5680 0x7f79600d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:42.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.337+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79780e3960 con 0x7f7984115410 2026-02-13T01:30:42.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.337+0000 7f798a08d6c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f79600b5680 0x7f79600d5b30 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7974006f90 tx=0x7f7974009290 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:42.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.461+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79840f5dc0 con 0x7f7984115410 2026-02-13T01:30:42.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.461+0000 7f796b7fe6c0 1 -- 10.20.193.28:0/3981376505 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79780a5f10 con 0x7f7984115410 2026-02-13T01:30:42.463 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:42.463 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:42.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f79600b5680 msgr2=0x7f79600d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:42.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f79600b5680 0x7f79600d5b30 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7974006f90 tx=0x7f7974009290 comp rx=0 tx=0).stop 2026-02-13T01:30:42.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 msgr2=0x7f7984175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:42.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175cb0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7978004750 tx=0x7f797800b8e0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 shutdown_connections 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f79600b5680 0x7f79600d5b30 unknown :-1 s=CLOSED pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f79840f5340 0x7f79840fa570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7984115410 0x7f7984175cb0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 --2- 10.20.193.28:0/3981376505 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f798410f200 0x7f79840f4d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 >> 10.20.193.28:0/3981376505 conn(0x7f79840ecb00 msgr2=0x7f798410d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 shutdown_connections 2026-02-13T01:30:42.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:42.463+0000 7f798c3186c0 1 -- 10.20.193.28:0/3981376505 wait complete. 2026-02-13T01:30:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:42 trial187 ceph-mon[27464]: pgmap v358: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:43.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:42 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/3981376505' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:42 trial028 ceph-mon[22984]: pgmap v358: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:43.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:42 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/3981376505' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:43.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:42 trial134 ceph-mon[27948]: pgmap v358: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:43.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:42 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/3981376505' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:44.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:43 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:30:44.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:43 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:30:44.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:43 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:30:45.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: pgmap v359: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:45.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:45.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:30:45.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:30:45.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: pgmap v360: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:45.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:30:45.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:30:45.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:44 trial028 ceph-mon[22984]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: pgmap v359: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: pgmap v360: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:30:45.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:44 trial134 ceph-mon[27948]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:45.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: pgmap v359: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: pgmap v360: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:30:45.394 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:44 trial187 ceph-mon[27464]: from='mgr.14116 10.20.193.28:0/3894205474' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:45.569 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:45.753 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:45.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/3485358839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae810f060 msgr2=0x7f3ae810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/3485358839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae810f060 0x7f3ae810f430 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=7782457275445888828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ad80099a0 tx=0x7f3ad802ed50 comp rx=0 tx=0).stop 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/3485358839 shutdown_connections 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/3485358839 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3ae8115270 0x7f3ae8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/3485358839 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3ae810fa50 0x7f3ae8114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/3485358839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae810f060 0x7f3ae810f430 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=7782457275445888828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/3485358839 >> 10.20.193.28:0/3485358839 conn(0x7f3ae80ec980 msgr2=0x7f3ae810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/3485358839 shutdown_connections 2026-02-13T01:30:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.949+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/3485358839 wait complete. 2026-02-13T01:30:45.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 Processor -- start 2026-02-13T01:30:45.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 -- start start 2026-02-13T01:30:45.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3ae810f060 0x7f3ae811cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:45.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3ae8115270 0x7f3ae811d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:45.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 0x7f3ae8122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:45.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae8123240 con 0x7f3ae8122830 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae81233b0 con 0x7f3ae8115270 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aee3bf6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae8123570 con 0x7f3ae810f060 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 0x7f3ae8122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 0x7f3ae8122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41518/0 (socket says 10.20.193.28:41518) 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 -- 10.20.193.28:0/2520763794 learned_addr learned my addr 10.20.193.28:0/2520763794 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aecbbc6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3ae8115270 0x7f3ae811d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aed3bd6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3ae810f060 0x7f3ae811cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 -- 10.20.193.28:0/2520763794 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3ae810f060 msgr2=0x7f3ae811cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3ae810f060 0x7f3ae811cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 -- 10.20.193.28:0/2520763794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3ae8115270 msgr2=0x7f3ae811d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3ae8115270 0x7f3ae811d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.950+0000 7f3aedbbe6c0 1 -- 10.20.193.28:0/2520763794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad8009590 con 0x7f3ae8122830 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3aedbbe6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 0x7f3ae8122cd0 secure :-1 s=READY pgs=344 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ae4006ea0 tx=0x7f3ae400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ae4003c40 con 0x7f3ae8122830 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ae4003da0 con 0x7f3ae8122830 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ae40081c0 con 0x7f3ae8122830 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae8163a20 con 0x7f3ae8122830 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae8163eb0 con 0x7f3ae8122830 2026-02-13T01:30:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.951+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae8110330 con 0x7f3ae8122830 2026-02-13T01:30:45.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.954+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f3ae400d590 con 0x7f3ae8122830 2026-02-13T01:30:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.956+0000 7f3ad67fc6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ac40b5680 0x7f3ac40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.956+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f3ae40e4c40 con 0x7f3ae8122830 2026-02-13T01:30:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.956+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3ae40e50c0 con 0x7f3ae8122830 2026-02-13T01:30:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.956+0000 7f3aed3bd6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ac40b5680 0x7f3ac40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:45.956+0000 7f3aed3bd6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ac40b5680 0x7f3ac40d5b30 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ad80023e0 tx=0x7f3ad8005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:46.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.084+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ae811e080 con 0x7f3ae8122830 2026-02-13T01:30:46.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.084+0000 7f3ad67fc6c0 1 -- 10.20.193.28:0/2520763794 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3ae40a7670 con 0x7f3ae8122830 2026-02-13T01:30:46.086 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:46.086 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:46.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ac40b5680 msgr2=0x7f3ac40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:46.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ac40b5680 0x7f3ac40d5b30 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ad80023e0 tx=0x7f3ad8005c80 comp rx=0 tx=0).stop 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 msgr2=0x7f3ae8122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 0x7f3ae8122cd0 secure :-1 s=READY pgs=344 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ae4006ea0 tx=0x7f3ae400ce50 comp rx=0 tx=0).stop 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 shutdown_connections 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ae8122830 0x7f3ae8122cd0 unknown :-1 s=CLOSED pgs=344 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f3ae8115270 0x7f3ae811d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f3ac40b5680 0x7f3ac40d5b30 unknown :-1 s=CLOSED pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 --2- 10.20.193.28:0/2520763794 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f3ae810f060 0x7f3ae811cf30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 >> 10.20.193.28:0/2520763794 conn(0x7f3ae80ec980 msgr2=0x7f3ae810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:46.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.085+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 shutdown_connections 2026-02-13T01:30:46.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:46.086+0000 7f3aee3bf6c0 1 -- 10.20.193.28:0/2520763794 wait complete. 2026-02-13T01:30:46.145 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:45 trial028 ceph-mon[22984]: pgmap v361: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:46.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:45 trial134 ceph-mon[27948]: pgmap v361: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:46.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:45 trial187 ceph-mon[27464]: pgmap v361: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:47.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:46 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/2520763794' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:47.348 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:46 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/2520763794' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:47.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:46 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/2520763794' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:48.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:47 trial134 ceph-mon[27948]: pgmap v362: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:48.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:47 trial187 ceph-mon[27464]: pgmap v362: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:48.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:47 trial028 ceph-mon[22984]: pgmap v362: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-13T01:30:49.189 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:49.375 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/2301156158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c010f200 msgr2=0x7ff2c010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/2301156158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c010f200 0x7ff2c010f5d0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=5075860662842742244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b00099a0 tx=0x7ff2b002ed00 comp rx=0 tx=0).stop 2026-02-13T01:30:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/2301156158 shutdown_connections 2026-02-13T01:30:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/2301156158 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010fbf0 0x7ff2c0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/2301156158 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff2c0115410 0x7ff2c0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/2301156158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c010f200 0x7ff2c010f5d0 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=5075860662842742244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/2301156158 >> 10.20.193.28:0/2301156158 conn(0x7ff2c00ecb00 msgr2=0x7ff2c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:49.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/2301156158 shutdown_connections 2026-02-13T01:30:49.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.573+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/2301156158 wait complete. 2026-02-13T01:30:49.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.574+0000 7ff2c7bc06c0 1 Processor -- start 2026-02-13T01:30:49.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.574+0000 7ff2c7bc06c0 1 -- start start 2026-02-13T01:30:49.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.574+0000 7ff2c7bc06c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010f200 0x7ff2c011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.574+0000 7ff2c7bc06c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 0x7ff2c011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.574+0000 7ff2c7bc06c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff2c0122af0 0x7ff2c0122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c7bc06c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0123500 con 0x7ff2c0115410 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c7bc06c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0123670 con 0x7ff2c0122af0 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c7bc06c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0123830 con 0x7ff2c010f200 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 0x7ff2c011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 0x7ff2c011d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39390/0 (socket says 10.20.193.28:39390) 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 -- 10.20.193.28:0/1306100159 learned_addr learned my addr 10.20.193.28:0/1306100159 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c59356c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010f200 0x7ff2c011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c61366c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff2c0122af0 0x7ff2c0122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:49.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 -- 10.20.193.28:0/1306100159 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010f200 msgr2=0x7ff2c011d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010f200 0x7ff2c011d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 -- 10.20.193.28:0/1306100159 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff2c0122af0 msgr2=0x7ff2c0122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff2c0122af0 0x7ff2c0122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 -- 10.20.193.28:0/1306100159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b0009590 con 0x7ff2c0115410 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c59356c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010f200 0x7ff2c011d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c51346c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 0x7ff2c011d730 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b400b750 tx=0x7ff2b400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2b4004a80 con 0x7ff2c0115410 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c0163ce0 con 0x7ff2c0115410 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c0164170 con 0x7ff2c0115410 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff2b4009030 con 0x7ff2c0115410 2026-02-13T01:30:49.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.575+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2b4005690 con 0x7ff2c0115410 2026-02-13T01:30:49.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.576+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff288005310 con 0x7ff2c0115410 2026-02-13T01:30:49.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.578+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ff2b4004d00 con 0x7ff2c0115410 2026-02-13T01:30:49.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.580+0000 7ff2aeffd6c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff29c0b5680 0x7ff29c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:49.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.580+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7ff2b40e3b60 con 0x7ff2c0115410 2026-02-13T01:30:49.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.580+0000 7ff2c59356c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff29c0b5680 0x7ff29c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:49.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.580+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff2b411c5e0 con 0x7ff2c0115410 2026-02-13T01:30:49.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.580+0000 7ff2c59356c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff29c0b5680 0x7ff29c0d5b30 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b00023e0 tx=0x7ff2b002f5c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:49.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.704+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff288005960 con 0x7ff2c0115410 2026-02-13T01:30:49.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.704+0000 7ff2aeffd6c0 1 -- 10.20.193.28:0/1306100159 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff2b40a6590 con 0x7ff2c0115410 2026-02-13T01:30:49.705 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:49.705 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.705+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff29c0b5680 msgr2=0x7ff29c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.705+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff29c0b5680 0x7ff29c0d5b30 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b00023e0 tx=0x7ff2b002f5c0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.705+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 msgr2=0x7ff2c011d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.705+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 0x7ff2c011d730 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2b400b750 tx=0x7ff2b400bc20 comp rx=0 tx=0).stop 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 shutdown_connections 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ff2c0122af0 0x7ff2c0122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2c0115410 0x7ff2c011d730 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ff29c0b5680 0x7ff29c0d5b30 unknown :-1 s=CLOSED pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 --2- 10.20.193.28:0/1306100159 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ff2c010f200 0x7ff2c011d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 >> 10.20.193.28:0/1306100159 conn(0x7ff2c00ecb00 msgr2=0x7ff2c010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 shutdown_connections 2026-02-13T01:30:49.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:49.706+0000 7ff2c7bc06c0 1 -- 10.20.193.28:0/1306100159 wait complete. 2026-02-13T01:30:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:49 trial028 ceph-mon[22984]: pgmap v363: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T01:30:50.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:49 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1306100159' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:50.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:49 trial134 ceph-mon[27948]: pgmap v363: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T01:30:50.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:49 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1306100159' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:50.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:49 trial187 ceph-mon[27464]: pgmap v363: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-13T01:30:50.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:49 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1306100159' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:52.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:51 trial134 ceph-mon[27948]: pgmap v364: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:30:52.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:51 trial187 ceph-mon[27464]: pgmap v364: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:30:52.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:51 trial028 ceph-mon[22984]: pgmap v364: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 5 op/s 2026-02-13T01:30:52.811 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:52.996 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:53.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 -- 10.20.193.28:0/3676198658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 msgr2=0x7f30fc17a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:53.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 --2- 10.20.193.28:0/3676198658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 0x7f30fc17a100 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=17353656269141240385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30f800aa70 tx=0x7f30f802fde0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 -- 10.20.193.28:0/3676198658 shutdown_connections 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 --2- 10.20.193.28:0/3676198658 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc114190 0x7f30fc115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 --2- 10.20.193.28:0/3676198658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 0x7f30fc17a100 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=17353656269141240385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 --2- 10.20.193.28:0/3676198658 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc1137a0 0x7f30fc113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 -- 10.20.193.28:0/3676198658 >> 10.20.193.28:0/3676198658 conn(0x7f30fc061510 msgr2=0x7f30fc061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 -- 10.20.193.28:0/3676198658 shutdown_connections 2026-02-13T01:30:53.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.198+0000 7f310204e6c0 1 -- 10.20.193.28:0/3676198658 wait complete. 2026-02-13T01:30:53.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 Processor -- start 2026-02-13T01:30:53.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 -- start start 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 0x7f30fc121480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 0x7f30fc1219c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc126d80 0x7f30fc127220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc127790 con 0x7f30fc116520 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc127900 con 0x7f30fc126d80 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310204e6c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc127ac0 con 0x7f30fc1137a0 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 0x7f30fc121480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 0x7f30fc121480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.187:3300/0 says I am v2:10.20.193.28:51758/0 (socket says 10.20.193.28:51758) 2026-02-13T01:30:53.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 -- 10.20.193.28:0/781200649 learned_addr learned my addr 10.20.193.28:0/781200649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310084b6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 0x7f30fc1219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310184d6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc126d80 0x7f30fc127220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 -- 10.20.193.28:0/781200649 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc126d80 msgr2=0x7f30fc127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc126d80 0x7f30fc127220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 -- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 msgr2=0x7f30fc1219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 0x7f30fc1219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310104c6c0 1 -- 10.20.193.28:0/781200649 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f800a660 con 0x7f30fc1137a0 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.199+0000 7f310184d6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc126d80 0x7f30fc127220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.200+0000 7f310104c6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 0x7f30fc121480 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30ec009490 tx=0x7f30ec00bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:53.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.200+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30ec004a80 con 0x7f30fc1137a0 2026-02-13T01:30:53.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.200+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f30ec009030 con 0x7f30fc1137a0 2026-02-13T01:30:53.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.200+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30ec0071c0 con 0x7f30fc1137a0 2026-02-13T01:30:53.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.200+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc167f70 con 0x7f30fc1137a0 2026-02-13T01:30:53.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.200+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc168400 con 0x7f30fc1137a0 2026-02-13T01:30:53.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.201+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc114840 con 0x7f30fc1137a0 2026-02-13T01:30:53.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.203+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f30ec004060 con 0x7f30fc1137a0 2026-02-13T01:30:53.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.205+0000 7f30ea7fc6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f30d80b5600 0x7f30d80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:53.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.205+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7f30ec0e3bb0 con 0x7f30fc1137a0 2026-02-13T01:30:53.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.205+0000 7f310084b6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f30d80b5600 0x7f30d80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:53.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.205+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f30ec11c620 con 0x7f30fc1137a0 2026-02-13T01:30:53.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.206+0000 7f310084b6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f30d80b5600 0x7f30d80d5ab0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30fc127e10 tx=0x7f30f0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:53.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.330+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f30fc113b70 con 0x7f30fc1137a0 2026-02-13T01:30:53.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.330+0000 7f30ea7fc6c0 1 -- 10.20.193.28:0/781200649 <== mon.1 v2:10.20.193.187:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f30ec0a65e0 con 0x7f30fc1137a0 2026-02-13T01:30:53.331 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:53.331 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f30d80b5600 msgr2=0x7f30d80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f30d80b5600 0x7f30d80d5ab0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30fc127e10 tx=0x7f30f0009260 comp rx=0 tx=0).stop 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 msgr2=0x7f30fc121480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 0x7f30fc121480 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30ec009490 tx=0x7f30ec00bca0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 shutdown_connections 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7f30fc126d80 0x7f30fc127220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30fc116520 0x7f30fc1219c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7f30d80b5600 0x7f30d80d5ab0 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 --2- 10.20.193.28:0/781200649 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7f30fc1137a0 0x7f30fc121480 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:53.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 >> 10.20.193.28:0/781200649 conn(0x7f30fc061510 msgr2=0x7f30fc116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:53.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.331+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 shutdown_connections 2026-02-13T01:30:53.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:53.332+0000 7f310204e6c0 1 -- 10.20.193.28:0/781200649 wait complete. 2026-02-13T01:30:54.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:53 trial134 ceph-mon[27948]: pgmap v365: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:30:54.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:53 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/781200649' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:54.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:53 trial187 ceph-mon[27464]: pgmap v365: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:30:54.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:53 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/781200649' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:54.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:53 trial028 ceph-mon[22984]: pgmap v365: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 4 op/s 2026-02-13T01:30:54.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:53 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/781200649' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:56.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:55 trial134 ceph-mon[27948]: pgmap v366: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:30:56.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:55 trial187 ceph-mon[27464]: pgmap v366: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:30:56.435 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:56.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:55 trial028 ceph-mon[22984]: pgmap v366: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-13T01:30:56.619 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:30:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.815+0000 7ffb275776c0 1 -- 10.20.193.28:0/2262528847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb2810fa50 msgr2=0x7ffb28114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.815+0000 7ffb275776c0 1 --2- 10.20.193.28:0/2262528847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb2810fa50 0x7ffb28114a90 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=18390453678014798467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb100098d0 tx=0x7ffb1002ec30 comp rx=0 tx=0).stop 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 -- 10.20.193.28:0/2262528847 shutdown_connections 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 --2- 10.20.193.28:0/2262528847 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb28115270 0x7ffb28175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 --2- 10.20.193.28:0/2262528847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb2810fa50 0x7ffb28114a90 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=18390453678014798467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 --2- 10.20.193.28:0/2262528847 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ffb2810f060 0x7ffb2810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 -- 10.20.193.28:0/2262528847 >> 10.20.193.28:0/2262528847 conn(0x7ffb280ec980 msgr2=0x7ffb2810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 -- 10.20.193.28:0/2262528847 shutdown_connections 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 -- 10.20.193.28:0/2262528847 wait complete. 2026-02-13T01:30:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 Processor -- start 2026-02-13T01:30:56.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.816+0000 7ffb275776c0 1 -- start start 2026-02-13T01:30:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb275776c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 0x7ffb280f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb275776c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb28115270 0x7ffb28175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb275776c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ffb280f5000 0x7ffb280fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:56.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb275776c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280f56f0 con 0x7ffb28115270 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb275776c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280fa810 con 0x7ffb2810f060 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb275776c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280fa9d0 con 0x7ffb280f5000 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb25d746c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb28115270 0x7ffb28175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 0x7ffb280f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 0x7ffb280f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.134:3300/0 says I am v2:10.20.193.28:41686/0 (socket says 10.20.193.28:41686) 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 -- 10.20.193.28:0/1936560807 learned_addr learned my addr 10.20.193.28:0/1936560807 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb26d766c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ffb280f5000 0x7ffb280fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 -- 10.20.193.28:0/1936560807 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ffb280f5000 msgr2=0x7ffb280fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ffb280f5000 0x7ffb280fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 -- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb28115270 msgr2=0x7ffb28175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb28115270 0x7ffb28175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.817+0000 7ffb265756c0 1 -- 10.20.193.28:0/1936560807 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb100094c0 con 0x7ffb2810f060 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb265756c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 0x7ffb280f49d0 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb1c00b830 tx=0x7ffb1c00bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb1c004a80 con 0x7ffb2810f060 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb280facb0 con 0x7ffb2810f060 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffb1c009030 con 0x7ffb2810f060 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb1c00cd50 con 0x7ffb2810f060 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb280fb440 con 0x7ffb2810f060 2026-02-13T01:30:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.818+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb28110330 con 0x7ffb2810f060 2026-02-13T01:30:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.821+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ffb1c005000 con 0x7ffb2810f060 2026-02-13T01:30:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.823+0000 7ffb0f7fe6c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ffb000b5600 0x7ffb000d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.823+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7ffb1c0e3a30 con 0x7ffb2810f060 2026-02-13T01:30:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.823+0000 7ffb25d746c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ffb000b5600 0x7ffb000d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.823+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffb1c11c5e0 con 0x7ffb2810f060 2026-02-13T01:30:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.823+0000 7ffb25d746c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ffb000b5600 0x7ffb000d5ab0 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb280fb360 tx=0x7ffb100023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:56.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.951+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffb280f5b20 con 0x7ffb2810f060 2026-02-13T01:30:56.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.951+0000 7ffb0f7fe6c0 1 -- 10.20.193.28:0/1936560807 <== mon.2 v2:10.20.193.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ffb1c0a64f0 con 0x7ffb2810f060 2026-02-13T01:30:56.952 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:30:56.952 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:56.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.952+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ffb000b5600 msgr2=0x7ffb000d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.952+0000 7ffb275776c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ffb000b5600 0x7ffb000d5ab0 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb280fb360 tx=0x7ffb100023a0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.952+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 msgr2=0x7ffb280f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.952+0000 7ffb275776c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 0x7ffb280f49d0 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb1c00b830 tx=0x7ffb1c00bd00 comp rx=0 tx=0).stop 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 shutdown_connections 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7ffb000b5600 0x7ffb000d5ab0 unknown :-1 s=CLOSED pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7ffb280f5000 0x7ffb280fa2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb28115270 0x7ffb28175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 --2- 10.20.193.28:0/1936560807 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7ffb2810f060 0x7ffb280f49d0 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 >> 10.20.193.28:0/1936560807 conn(0x7ffb280ec980 msgr2=0x7ffb2810d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:56.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 shutdown_connections 2026-02-13T01:30:56.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:30:56.953+0000 7ffb275776c0 1 -- 10.20.193.28:0/1936560807 wait complete. 2026-02-13T01:30:57.014 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:56 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1936560807' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:57.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:56 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1936560807' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:57.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:56 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1936560807' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:58.302 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:30:58 trial134 ceph-mon[27948]: pgmap v367: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:58.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:30:58 trial187 ceph-mon[27464]: pgmap v367: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:30:58.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:30:57 trial028 ceph-mon[22984]: pgmap v367: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-13T01:31:00.058 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:31:00.244 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:31:00.286 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:00 trial028 ceph-mon[22984]: pgmap v368: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:31:00.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:31:00 trial134 ceph-mon[27948]: pgmap v368: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:31:00.393 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:00 trial187 ceph-mon[27464]: pgmap v368: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 -- 10.20.193.28:0/1994507922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 msgr2=0x7fa51410c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1994507922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa51410c980 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=9650093957685025165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa50400aa40 tx=0x7fa50402fe00 comp rx=0 tx=0).stop 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 -- 10.20.193.28:0/1994507922 shutdown_connections 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1994507922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa51410c980 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=9650093957685025165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1994507922 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa514112fc0 0x7fa51410b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1994507922 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa514112b10 0x7fa51410b1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 -- 10.20.193.28:0/1994507922 >> 10.20.193.28:0/1994507922 conn(0x7fa514063af0 msgr2=0x7fa5140642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:31:00.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 -- 10.20.193.28:0/1994507922 shutdown_connections 2026-02-13T01:31:00.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.452+0000 7fa5192896c0 1 -- 10.20.193.28:0/1994507922 wait complete. 2026-02-13T01:31:00.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 Processor -- start 2026-02-13T01:31:00.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 -- start start 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa5140f2ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 --2- >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa514112b10 0x7fa5140f3000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 --2- >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa514112fc0 0x7fa5140f8370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140f89c0 con 0x7fa51410c4e0 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 -- --> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140f8b30 con 0x7fa514112fc0 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.453+0000 7fa5192896c0 1 -- --> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140f8cf0 con 0x7fa514112b10 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa5140f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa5140f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43138/0 (socket says 10.20.193.28:43138) 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 -- 10.20.193.28:0/1051674866 learned_addr learned my addr 10.20.193.28:0/1051674866 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa5135776c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa514112fc0 0x7fa5140f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa5125756c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa514112b10 0x7fa5140f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:31:00.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 -- 10.20.193.28:0/1051674866 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa514112b10 msgr2=0x7fa5140f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa514112b10 0x7fa5140f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 -- 10.20.193.28:0/1051674866 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa514112fc0 msgr2=0x7fa5140f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa514112fc0 0x7fa5140f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 -- 10.20.193.28:0/1051674866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50400a660 con 0x7fa51410c4e0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa512d766c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa5140f2ac0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa508009490 tx=0x7fa50800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa508004a80 con 0x7fa51410c4e0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa508009030 con 0x7fa51410c4e0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa50800ce50 con 0x7fa51410c4e0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5140f8fd0 con 0x7fa51410c4e0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.454+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5140f9690 con 0x7fa51410c4e0 2026-02-13T01:31:00.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.455+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5140f91f0 con 0x7fa51410c4e0 2026-02-13T01:31:00.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.457+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fa508004ce0 con 0x7fa51410c4e0 2026-02-13T01:31:00.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.459+0000 7fa4f3fff6c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4e40b5680 0x7fa4e40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:31:00.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.459+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8110+0+0 (secure 0 0 0) 0x7fa5080e3ad0 con 0x7fa51410c4e0 2026-02-13T01:31:00.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.459+0000 7fa5125756c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4e40b5680 0x7fa4e40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:31:00.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.459+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa50811c5e0 con 0x7fa51410c4e0 2026-02-13T01:31:00.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.460+0000 7fa5125756c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4e40b5680 0x7fa4e40d5b30 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4fc005980 tx=0x7fa4fc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:31:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.584+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa514065120 con 0x7fa51410c4e0 2026-02-13T01:31:00.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.585+0000 7fa4f3fff6c0 1 -- 10.20.193.28:0/1051674866 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa5080a6540 con 0x7fa51410c4e0 2026-02-13T01:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-13T01:31:00.585 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4e40b5680 msgr2=0x7fa4e40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4e40b5680 0x7fa4e40d5b30 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4fc005980 tx=0x7fa4fc005910 comp rx=0 tx=0).stop 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 msgr2=0x7fa5140f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa5140f2ac0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa508009490 tx=0x7fa50800bc50 comp rx=0 tx=0).stop 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 shutdown_connections 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:6800/378944679,v1:10.20.193.28:6801/378944679] conn(0x7fa4e40b5680 0x7fa4e40d5b30 unknown :-1 s=CLOSED pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.187:3300/0,v1:10.20.193.187:6789/0] conn(0x7fa514112b10 0x7fa5140f3000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.134:3300/0,v1:10.20.193.134:6789/0] conn(0x7fa514112fc0 0x7fa5140f8370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 --2- 10.20.193.28:0/1051674866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa51410c4e0 0x7fa5140f2ac0 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:31:00.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 >> 10.20.193.28:0/1051674866 conn(0x7fa514063af0 msgr2=0x7fa5140ed320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:31:00.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.586+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 shutdown_connections 2026-02-13T01:31:00.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-13T01:31:00.587+0000 7fa5192896c0 1 -- 10.20.193.28:0/1051674866 wait complete. 2026-02-13T01:31:00.722 INFO:tasks.cephadm:Teardown begin 2026-02-13T01:31:00.722 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T01:31:00.726 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:31:00.783 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:31:00.812 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:31:00.843 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T01:31:00.843 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70ced355-087a-11f1-9708-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T01:31:01.024 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/mon.a/config 2026-02-13T01:31:01.061 INFO:teuthology.orchestra.run.trial028.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T01:31:01.088 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T01:31:01.089 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T01:31:01.089 DEBUG:teuthology.orchestra.run.trial028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:31:01.128 DEBUG:teuthology.orchestra.run.trial134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:31:01.143 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:01 trial187 ceph-mon[27464]: from='client.? 10.20.193.28:0/1051674866' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:31:01.145 DEBUG:teuthology.orchestra.run.trial187:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:31:01.163 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T01:31:01.163 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T01:31:01.164 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a 2026-02-13T01:31:01.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 ceph-mon[22984]: from='client.? 10.20.193.28:0/1051674866' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:31:01.301 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:31:01 trial134 ceph-mon[27948]: from='client.? 10.20.193.28:0/1051674866' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:31:01.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 systemd[1]: Stopping Ceph mon.a for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:01.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a[22980]: 2026-02-13T01:31:01.348+0000 7f89995f46c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:01.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a[22980]: 2026-02-13T01:31:01.348+0000 7f89995f46c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T01:31:01.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 podman[71751]: 2026-02-13 01:31:01.379916803 +0000 UTC m=+0.054380604 container died 13c52e80a4dcc06e96f8b1f53307b4b2eb62dd3f1c1782cbab57a6c22baa5ceb (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, io.buildah.version=1.33.7, ceph=True) 2026-02-13T01:31:01.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 podman[71751]: 2026-02-13 01:31:01.438400284 +0000 UTC m=+0.112864075 container remove 13c52e80a4dcc06e96f8b1f53307b4b2eb62dd3f1c1782cbab57a6c22baa5ceb (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, license=BSD-3-Clause, name=rockylinux) 2026-02-13T01:31:01.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 13 01:31:01 trial028 bash[71751]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-a 2026-02-13T01:31:01.547 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.a.service' 2026-02-13T01:31:01.663 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:01.663 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T01:31:01.664 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T01:31:01.664 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.b 2026-02-13T01:31:01.963 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:31:01 trial134 systemd[1]: Stopping Ceph mon.b for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:01.963 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:31:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-b[27944]: 2026-02-13T01:31:01.762+0000 7f682cfcb6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:01.963 INFO:journalctl@ceph.mon.b.trial134.stdout:Feb 13 01:31:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-b[27944]: 2026-02-13T01:31:01.762+0000 7f682cfcb6c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-13T01:31:02.051 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.b.service' 2026-02-13T01:31:02.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:02.090 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T01:31:02.090 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T01:31:02.090 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.c 2026-02-13T01:31:02.370 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:02 trial187 systemd[1]: Stopping Ceph mon.c for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:02.370 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-c[27449]: 2026-02-13T01:31:02.193+0000 7fce9aa186c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:02.370 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-c[27449]: 2026-02-13T01:31:02.193+0000 7fce9aa186c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-13T01:31:02.370 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:02 trial187 podman[61040]: 2026-02-13 01:31:02.345517109 +0000 UTC m=+0.165376936 container died 0fc64123cc1c0688ec6c57fa0ee1d24f56106650261fcca9ced8409ba66d9bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-c, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, version=10) 2026-02-13T01:31:02.370 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:02 trial187 podman[61040]: 2026-02-13 01:31:02.354975403 +0000 UTC m=+0.174835230 container remove 0fc64123cc1c0688ec6c57fa0ee1d24f56106650261fcca9ced8409ba66d9bf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-c, io.buildah.version=1.33.7, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, name=rockylinux) 2026-02-13T01:31:02.370 INFO:journalctl@ceph.mon.c.trial187.stdout:Feb 13 01:31:02 trial187 bash[61040]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-mon-c 2026-02-13T01:31:02.428 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mon.c.service' 2026-02-13T01:31:02.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:02.468 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T01:31:02.468 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T01:31:02.469 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x 2026-02-13T01:31:02.772 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:31:02 trial028 systemd[1]: Stopping Ceph mgr.x for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:02.772 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:31:02 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:31:02.651+0000 7f0cc4bd06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:02.772 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:31:02 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x[23206]: 2026-02-13T01:31:02.651+0000 7f0cc4bd06c0 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-13T01:31:02.772 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 13 01:31:02 trial028 podman[71880]: 2026-02-13 01:31:02.704290517 +0000 UTC m=+0.075081248 container died 7e1c873178a04b19621e5b54d0e9df884906ffd60b584d5129abd4517f556604 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-mgr-x, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:02.889 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.x.service' 2026-02-13T01:31:02.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:02.959 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T01:31:02.959 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T01:31:02.960 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.y 2026-02-13T01:31:03.182 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.y.service' 2026-02-13T01:31:03.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:03.217 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T01:31:03.217 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T01:31:03.217 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.z 2026-02-13T01:31:03.408 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mgr.z.service' 2026-02-13T01:31:03.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:03.443 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T01:31:03.444 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T01:31:03.444 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.0 2026-02-13T01:31:03.946 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:03 trial028 systemd[1]: Stopping Ceph osd.0 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:03.946 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:03 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0[34315]: 2026-02-13T01:31:03.618+0000 7f9b5268e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:03.946 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:03 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0[34315]: 2026-02-13T01:31:03.618+0000 7f9b5268e6c0 -1 osd.0 79 *** Got signal Terminated *** 2026-02-13T01:31:03.947 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:03 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0[34315]: 2026-02-13T01:31:03.618+0000 7f9b5268e6c0 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:09.023 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:08 trial028 podman[72012]: 2026-02-13 01:31:08.714928912 +0000 UTC m=+5.118411233 container died 40532d84ad1a719dd27a4c5a75df49f70dab0919cffc9978b8744ea20700ad73 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, ceph=True, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:09.023 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:08 trial028 podman[72012]: 2026-02-13 01:31:08.774679143 +0000 UTC m=+5.178161454 container remove 40532d84ad1a719dd27a4c5a75df49f70dab0919cffc9978b8744ea20700ad73 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, OSD_FLAVOR=default, name=rockylinux, license=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:31:09.023 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:08 trial028 bash[72012]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0 2026-02-13T01:31:09.274 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:09 trial028 podman[72110]: 2026-02-13 01:31:09.023187723 +0000 UTC m=+0.028351906 container create e9811a157028e40cc415975e4d5624391b62828e57d0d825741f0d87d0517b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:09.275 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:09 trial028 podman[72110]: 2026-02-13 01:31:09.070346851 +0000 UTC m=+0.075511034 container init e9811a157028e40cc415975e4d5624391b62828e57d0d825741f0d87d0517b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0-deactivate, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image) 2026-02-13T01:31:09.275 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:09 trial028 podman[72110]: 2026-02-13 01:31:09.075944453 +0000 UTC m=+0.081108646 container start e9811a157028e40cc415975e4d5624391b62828e57d0d825741f0d87d0517b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, version=10, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:31:09.275 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:09 trial028 podman[72110]: 2026-02-13 01:31:09.076738306 +0000 UTC m=+0.081902499 container attach e9811a157028e40cc415975e4d5624391b62828e57d0d825741f0d87d0517b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, version=10, summary=Rocky Linux Base image, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, name=rockylinux, license=BSD-3-Clause, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:31:09.275 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 13 01:31:09 trial028 podman[72110]: 2026-02-13 01:31:09.013285437 +0000 UTC m=+0.018449630 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:09.358 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.0.service' 2026-02-13T01:31:09.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:09.427 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T01:31:09.427 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T01:31:09.427 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.1 2026-02-13T01:31:09.801 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:09 trial134 systemd[1]: Stopping Ceph osd.1 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:09.802 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:09 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1[32733]: 2026-02-13T01:31:09.528+0000 7fe1466156c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:09.802 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:09 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1[32733]: 2026-02-13T01:31:09.528+0000 7fe1466156c0 -1 osd.1 79 *** Got signal Terminated *** 2026-02-13T01:31:09.802 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:09 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1[32733]: 2026-02-13T01:31:09.528+0000 7fe1466156c0 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:14.888 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[58888]: 2026-02-13 01:31:14.58819342 +0000 UTC m=+5.072403249 container died 4c4181fa62ee93e0b8d3baed03a48eb97b0ce5667ab587633135fad1ac6a0850 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[58888]: 2026-02-13 01:31:14.597203094 +0000 UTC m=+5.081412913 container remove 4c4181fa62ee93e0b8d3baed03a48eb97b0ce5667ab587633135fad1ac6a0850 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.version=10) 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 bash[58888]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[59020]: 2026-02-13 01:31:14.730326668 +0000 UTC m=+0.016016063 container create 4874f1b06f2ce672dd057ff1dc49de7a07bbe001dd3c59050719239805c95af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[59020]: 2026-02-13 01:31:14.759593367 +0000 UTC m=+0.045282752 container init 4874f1b06f2ce672dd057ff1dc49de7a07bbe001dd3c59050719239805c95af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[59020]: 2026-02-13 01:31:14.761959473 +0000 UTC m=+0.047648878 container start 4874f1b06f2ce672dd057ff1dc49de7a07bbe001dd3c59050719239805c95af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7, version=10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[59020]: 2026-02-13 01:31:14.762491879 +0000 UTC m=+0.048181274 container attach 4874f1b06f2ce672dd057ff1dc49de7a07bbe001dd3c59050719239805c95af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1-deactivate, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, version=10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[59020]: 2026-02-13 01:31:14.72371019 +0000 UTC m=+0.009399585 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:14.889 INFO:journalctl@ceph.osd.1.trial134.stdout:Feb 13 01:31:14 trial134 podman[59020]: 2026-02-13 01:31:14.890765149 +0000 UTC m=+0.176454554 container died 4874f1b06f2ce672dd057ff1dc49de7a07bbe001dd3c59050719239805c95af4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, summary=Rocky Linux Base image, version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:14.923 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.1.service' 2026-02-13T01:31:14.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:14.960 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T01:31:14.961 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T01:31:14.961 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.2 2026-02-13T01:31:15.393 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:15 trial187 systemd[1]: Stopping Ceph osd.2 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:15.393 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:15 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2[32596]: 2026-02-13T01:31:15.061+0000 7f49115386c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:15.393 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:15 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2[32596]: 2026-02-13T01:31:15.061+0000 7f49115386c0 -1 osd.2 79 *** Got signal Terminated *** 2026-02-13T01:31:15.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:15 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2[32596]: 2026-02-13T01:31:15.061+0000 7f49115386c0 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:20.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61362]: 2026-02-13 01:31:20.120877392 +0000 UTC m=+5.071771631 container died 122261a05adaf6679444830cc928f73a77925245dcbb45a733e095064b93b3b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, version=10, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:31:20.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61362]: 2026-02-13 01:31:20.130719303 +0000 UTC m=+5.081613543 container remove 122261a05adaf6679444830cc928f73a77925245dcbb45a733e095064b93b3b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2, license=BSD-3-Clause, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, name=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:31:20.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 bash[61362]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2 2026-02-13T01:31:20.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61493]: 2026-02-13 01:31:20.260621759 +0000 UTC m=+0.016941200 container create aca0de68fe376f9af982b9a9075c51b9b8cbcbd21e67362f8c9d3371c096029e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:31:20.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61493]: 2026-02-13 01:31:20.290504392 +0000 UTC m=+0.046823763 container init aca0de68fe376f9af982b9a9075c51b9b8cbcbd21e67362f8c9d3371c096029e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default) 2026-02-13T01:31:20.394 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61493]: 2026-02-13 01:31:20.293043795 +0000 UTC m=+0.049363166 container start aca0de68fe376f9af982b9a9075c51b9b8cbcbd21e67362f8c9d3371c096029e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T01:31:20.395 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61493]: 2026-02-13 01:31:20.29348945 +0000 UTC m=+0.049808831 container attach aca0de68fe376f9af982b9a9075c51b9b8cbcbd21e67362f8c9d3371c096029e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause) 2026-02-13T01:31:20.395 INFO:journalctl@ceph.osd.2.trial187.stdout:Feb 13 01:31:20 trial187 podman[61493]: 2026-02-13 01:31:20.254086237 +0000 UTC m=+0.010405608 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:20.454 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.2.service' 2026-02-13T01:31:20.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:20.491 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T01:31:20.491 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T01:31:20.491 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.3 2026-02-13T01:31:20.946 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:20 trial028 systemd[1]: Stopping Ceph osd.3 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:20.946 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:20 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3[40188]: 2026-02-13T01:31:20.675+0000 7f7976d1b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:20.947 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:20 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3[40188]: 2026-02-13T01:31:20.675+0000 7f7976d1b6c0 -1 osd.3 79 *** Got signal Terminated *** 2026-02-13T01:31:20.947 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:20 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3[40188]: 2026-02-13T01:31:20.675+0000 7f7976d1b6c0 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:26.075 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:25 trial028 podman[72224]: 2026-02-13 01:31:25.771398339 +0000 UTC m=+5.119036718 container died 00260f1741b753999d2ebbfae95901ac4e91452c91d491d1c5e15ba824bf2e49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, version=10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:26.075 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:25 trial028 podman[72224]: 2026-02-13 01:31:25.830182879 +0000 UTC m=+5.177821258 container remove 00260f1741b753999d2ebbfae95901ac4e91452c91d491d1c5e15ba824bf2e49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3, ceph=True, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default) 2026-02-13T01:31:26.075 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:25 trial028 bash[72224]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3 2026-02-13T01:31:26.327 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:26 trial028 podman[72326]: 2026-02-13 01:31:26.075120976 +0000 UTC m=+0.028618601 container create 72c85a5284552d64f12332bbcdc03a958d3779c1bb1213588241aa4b6327ddb1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3-deactivate, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default) 2026-02-13T01:31:26.327 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:26 trial028 podman[72326]: 2026-02-13 01:31:26.124415435 +0000 UTC m=+0.077913050 container init 72c85a5284552d64f12332bbcdc03a958d3779c1bb1213588241aa4b6327ddb1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3-deactivate, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, version=10) 2026-02-13T01:31:26.327 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:26 trial028 podman[72326]: 2026-02-13 01:31:26.129819067 +0000 UTC m=+0.083316692 container start 72c85a5284552d64f12332bbcdc03a958d3779c1bb1213588241aa4b6327ddb1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3-deactivate, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:31:26.327 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:26 trial028 podman[72326]: 2026-02-13 01:31:26.130734716 +0000 UTC m=+0.084232351 container attach 72c85a5284552d64f12332bbcdc03a958d3779c1bb1213588241aa4b6327ddb1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-13T01:31:26.327 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:26 trial028 podman[72326]: 2026-02-13 01:31:26.064586107 +0000 UTC m=+0.018083732 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:26.327 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 13 01:31:26 trial028 podman[72326]: 2026-02-13 01:31:26.314769974 +0000 UTC m=+0.268267599 container died 72c85a5284552d64f12332bbcdc03a958d3779c1bb1213588241aa4b6327ddb1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:26.400 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.3.service' 2026-02-13T01:31:26.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:26.471 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T01:31:26.471 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T01:31:26.472 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.4 2026-02-13T01:31:26.802 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:26 trial134 systemd[1]: Stopping Ceph osd.4 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:26.802 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4[38874]: 2026-02-13T01:31:26.574+0000 7fb89e8186c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:26.802 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4[38874]: 2026-02-13T01:31:26.574+0000 7fb89e8186c0 -1 osd.4 79 *** Got signal Terminated *** 2026-02-13T01:31:26.802 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:26 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4[38874]: 2026-02-13T01:31:26.574+0000 7fb89e8186c0 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:30.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:29 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:29.922+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:30.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:30 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:30.616+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:31.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:30 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:30.674+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:31.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:30 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:30.882+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:31.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:31 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:31.364+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:31.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:31 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:31.592+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:31.950 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:31 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:31.716+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59151]: 2026-02-13 01:31:31.643591031 +0000 UTC m=+5.083730371 container died 4b6159ef2b98d6af452850b2841122c7165365a6e3c2f8c062a9002414385a1c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, version=10) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59151]: 2026-02-13 01:31:31.652625732 +0000 UTC m=+5.092765072 container remove 4b6159ef2b98d6af452850b2841122c7165365a6e3c2f8c062a9002414385a1c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, version=10) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 bash[59151]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59285]: 2026-02-13 01:31:31.791561128 +0000 UTC m=+0.015067087 container create 05784ca3bbbd99348bbcaac3dc7707f108651eb00d1546ef6a22841742e8d3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4-deactivate, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59285]: 2026-02-13 01:31:31.825883394 +0000 UTC m=+0.049389353 container init 05784ca3bbbd99348bbcaac3dc7707f108651eb00d1546ef6a22841742e8d3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4-deactivate, summary=Rocky Linux Base image, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59285]: 2026-02-13 01:31:31.828327476 +0000 UTC m=+0.051833425 container start 05784ca3bbbd99348bbcaac3dc7707f108651eb00d1546ef6a22841742e8d3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59285]: 2026-02-13 01:31:31.828711615 +0000 UTC m=+0.052217574 container attach 05784ca3bbbd99348bbcaac3dc7707f108651eb00d1546ef6a22841742e8d3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4-deactivate, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image) 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59285]: 2026-02-13 01:31:31.785888366 +0000 UTC m=+0.009394325 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:31.951 INFO:journalctl@ceph.osd.4.trial134.stdout:Feb 13 01:31:31 trial134 podman[59285]: 2026-02-13 01:31:31.952697274 +0000 UTC m=+0.176203233 container died 05784ca3bbbd99348bbcaac3dc7707f108651eb00d1546ef6a22841742e8d3ce (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, OSD_FLAVOR=default, version=10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:31.985 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.4.service' 2026-02-13T01:31:32.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:32.021 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T01:31:32.021 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T01:31:32.021 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.5 2026-02-13T01:31:32.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:31 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:31.908+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:32.393 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:32 trial187 systemd[1]: Stopping Ceph osd.5 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:32.393 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:32.124+0000 7f847fba96c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:32.394 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:32.124+0000 7f847fba96c0 -1 osd.5 79 *** Got signal Terminated *** 2026-02-13T01:31:32.394 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:32.124+0000 7f847fba96c0 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:32.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:32 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:32.384+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:32.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:32.622+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:32.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:32.642+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:33.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:32 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:32.711+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:33.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:32 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:32.918+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:33.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:33 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:33.337+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:33.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:33 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:33.622+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:33.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:33 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:33.605+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:33.894 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:33 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:33.548+0000 7f847c26e6c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.480307+0000 front 2026-02-13T01:31:08.480369+0000 (oldest deadline 2026-02-13T01:31:33.180355+0000) 2026-02-13T01:31:34.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:33 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:33.747+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:34.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:33 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:33.939+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:34.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:34 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:34.342+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:34.893 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:34 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:34.598+0000 7f847c26e6c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.480307+0000 front 2026-02-13T01:31:08.480369+0000 (oldest deadline 2026-02-13T01:31:33.180355+0000) 2026-02-13T01:31:34.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:34 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:34.653+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:34.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:34 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:34.627+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:35.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:34 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:34.772+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:35.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:34 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:34.910+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:35.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:34 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:34.910+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:35.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:35 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:35.354+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:35.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:35 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:35.601+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:35.894 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:35 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:35.556+0000 7f847c26e6c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.480307+0000 front 2026-02-13T01:31:08.480369+0000 (oldest deadline 2026-02-13T01:31:33.180355+0000) 2026-02-13T01:31:35.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:35 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:35.650+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:35.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:35 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:35.650+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:36.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:35 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:35.749+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:36.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:35 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:35.749+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:36.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:35 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:35.894+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:36.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:35 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:35.894+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:36.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:36 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:36.374+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:36.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:36 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:36.374+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:36.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:36 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:36.624+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:36.894 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:36 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5[39152]: 2026-02-13T01:31:36.557+0000 7f847c26e6c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.480307+0000 front 2026-02-13T01:31:08.480369+0000 (oldest deadline 2026-02-13T01:31:33.180355+0000) 2026-02-13T01:31:36.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:36 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:36.657+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:36.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:36 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:36.657+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:37.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:36 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:36.798+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:37.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:36 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:36.798+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:37.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:36 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:36.907+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:37.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:36 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:36.907+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:37.487 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61630]: 2026-02-13 01:31:37.184153656 +0000 UTC m=+5.072518129 container died 6dab6be0ddcc671c6134053a63d54d109191a27993704bea5facf43264c6c343 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61630]: 2026-02-13 01:31:37.193034687 +0000 UTC m=+5.081399160 container remove 6dab6be0ddcc671c6134053a63d54d109191a27993704bea5facf43264c6c343 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause) 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 bash[61630]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61763]: 2026-02-13 01:31:37.335211534 +0000 UTC m=+0.016390307 container create 3c9f52e5a3a92250ecb9981e0b80114df5cc33af427a86bb2f242efa194dbb97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5-deactivate, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61763]: 2026-02-13 01:31:37.367391693 +0000 UTC m=+0.048570476 container init 3c9f52e5a3a92250ecb9981e0b80114df5cc33af427a86bb2f242efa194dbb97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5-deactivate, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, io.buildah.version=1.33.7, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61763]: 2026-02-13 01:31:37.369724769 +0000 UTC m=+0.050903552 container start 3c9f52e5a3a92250ecb9981e0b80114df5cc33af427a86bb2f242efa194dbb97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5-deactivate, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61763]: 2026-02-13 01:31:37.370218353 +0000 UTC m=+0.051397136 container attach 3c9f52e5a3a92250ecb9981e0b80114df5cc33af427a86bb2f242efa194dbb97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-5-deactivate, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:37.488 INFO:journalctl@ceph.osd.5.trial187.stdout:Feb 13 01:31:37 trial187 podman[61763]: 2026-02-13 01:31:37.328388394 +0000 UTC m=+0.009567177 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:37.518 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.5.service' 2026-02-13T01:31:37.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:37.556 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T01:31:37.556 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T01:31:37.556 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.6 2026-02-13T01:31:37.603 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:37.340+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:37.603 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:37.340+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:37.862 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:37 trial028 systemd[1]: Stopping Ceph osd.6 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:37.863 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:37.737+0000 7f2affcf46c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:37.863 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:37.737+0000 7f2affcf46c0 -1 osd.6 79 *** Got signal Terminated *** 2026-02-13T01:31:37.863 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:37.737+0000 7f2affcf46c0 -1 osd.6 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:37.863 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:37.862+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:37.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:37 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:37.699+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:37.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:37 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:37.699+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:37.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:37 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:37.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:37.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:37 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:37.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:38.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:37 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:37.777+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:38.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:37 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:37.777+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:38.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:37 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:37.862+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:38.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:38 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:38.334+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:38.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:38 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:38.334+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:38.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:38 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:38.720+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:38.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:38 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:38.720+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:38.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:38 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:38.597+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:38.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:38 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:38.597+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:39.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:38 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:38.774+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:39.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:38 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:38.774+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:39.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:38 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:38.885+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:39.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:38 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:38.885+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:39.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:39 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:39.286+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:39.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:39 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:39.286+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:39.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:39 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:39.711+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:39.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:39 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:39.711+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:39.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:39 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:39.623+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:39.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:39 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:39.623+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:40.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:39 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:39.784+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:40.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:39 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:39.784+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:40.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:39 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:39.873+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:40.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:39 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:39.873+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:40.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:40 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:40.303+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:40.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:40 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:40.303+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:40.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:40 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:40.735+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:40.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:40 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:40.735+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:40.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:40 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:40.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:40.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:40 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:40.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:40.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:40 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:40.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:41.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:40 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:40.819+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:41.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:40 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:40.819+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:41.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:40 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:40.803+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:41.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:40 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:40.881+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:41.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:40 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:40.881+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:41.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:41.285+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:41.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:41.285+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:41.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:41 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:41.782+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:41.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:41 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:41.782+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:41.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:41 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:41.782+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:41.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:41 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:41.569+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:41.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:41 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:41.569+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:41.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:41 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:41.569+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:42.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:41 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:41.768+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:42.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:41 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:41.768+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:42.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:41 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:41.836+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:42.053 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:41 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:41.836+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:42.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:41.927+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.044440+0000 front 2026-02-13T01:31:05.044544+0000 (oldest deadline 2026-02-13T01:31:29.144572+0000) 2026-02-13T01:31:42.196 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:41 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6[45841]: 2026-02-13T01:31:41.927+0000 7f2afc3b96c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.245798+0000 front 2026-02-13T01:31:14.245651+0000 (oldest deadline 2026-02-13T01:31:34.745607+0000) 2026-02-13T01:31:42.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:42 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:42.328+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:42.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:42 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:42.328+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:42.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:42 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:42.328+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:42.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:42 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:42.792+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:42.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:42 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:42.792+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:42.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:42 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:42.792+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:42.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:42 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:42.612+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:42.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:42 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:42.612+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:42.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:42 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:42.612+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:43.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:42 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:42.776+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:43.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:42 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:42.776+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:43.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:42 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:42.791+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:43.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:42 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:42.791+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:43.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:42 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:42.791+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:43.137 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:42 trial028 podman[72444]: 2026-02-13 01:31:42.834204184 +0000 UTC m=+5.118830713 container died b01d36415b931838fd6295fdec689bb527756c582cccd21d97433b03e155c3e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:43.137 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:42 trial028 podman[72444]: 2026-02-13 01:31:42.89301649 +0000 UTC m=+5.177643009 container remove b01d36415b931838fd6295fdec689bb527756c582cccd21d97433b03e155c3e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.version=10, version=10) 2026-02-13T01:31:43.137 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:42 trial028 bash[72444]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6 2026-02-13T01:31:43.392 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:43 trial028 podman[72540]: 2026-02-13 01:31:43.13757587 +0000 UTC m=+0.029433906 container create 36dffa846f040252fc5282b2be3722f253708c98ac4d9382f8fa1048a6fde80c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux) 2026-02-13T01:31:43.393 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:43 trial028 podman[72540]: 2026-02-13 01:31:43.19157101 +0000 UTC m=+0.083429066 container init 36dffa846f040252fc5282b2be3722f253708c98ac4d9382f8fa1048a6fde80c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, version=10) 2026-02-13T01:31:43.393 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:43 trial028 podman[72540]: 2026-02-13 01:31:43.197306571 +0000 UTC m=+0.089164617 container start 36dffa846f040252fc5282b2be3722f253708c98ac4d9382f8fa1048a6fde80c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, version=10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:43.393 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:43 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:43.306+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:43.394 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:43 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:43.306+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:43.394 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:43 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:43.306+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:43.394 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:43 trial028 podman[72540]: 2026-02-13 01:31:43.198031806 +0000 UTC m=+0.089889862 container attach 36dffa846f040252fc5282b2be3722f253708c98ac4d9382f8fa1048a6fde80c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, ceph=True, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:43.394 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:43 trial028 podman[72540]: 2026-02-13 01:31:43.126982427 +0000 UTC m=+0.018840483 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:43.394 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 13 01:31:43 trial028 podman[72540]: 2026-02-13 01:31:43.378998229 +0000 UTC m=+0.270856275 container died 36dffa846f040252fc5282b2be3722f253708c98ac4d9382f8fa1048a6fde80c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-6-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:43.462 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.6.service' 2026-02-13T01:31:43.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:43.531 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T01:31:43.531 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T01:31:43.531 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.7 2026-02-13T01:31:43.804 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:43 trial134 systemd[1]: Stopping Ceph osd.7 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:43.804 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:43.629+0000 7f66881906c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:43.804 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:43.629+0000 7f66881906c0 -1 osd.7 79 *** Got signal Terminated *** 2026-02-13T01:31:43.804 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:43.629+0000 7f66881906c0 -1 osd.7 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:43.804 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:43.739+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:43.804 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:43.739+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:43.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:43 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:43.619+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:43.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:43 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:43.619+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:43.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:43 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:43.619+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:43.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:43 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:43.768+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:43.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:43 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:43.768+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:43.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:43 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:43.768+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:44.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:43.805+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:44.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:43.805+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:44.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:43 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:43.805+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:44.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:44 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:44.282+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:44.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:44 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:44.282+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:44.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:44 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:44.282+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:44.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:44 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:44.736+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:44.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:44 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:44.736+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:44.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:44 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:44.736+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:44.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:44 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:44.604+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:44.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:44 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:44.604+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:44.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:44 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:44.604+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:45.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:44 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:44.739+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:45.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:44 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:44.739+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:45.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:44 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:44.804+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:45.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:44 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:44.804+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:45.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:44 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:44.804+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:45.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:45.332+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:45.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:45.332+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:45.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:45 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:45.332+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:45.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:45 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:45.689+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:45.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:45 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:45.689+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:45.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:45 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:45.689+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:45.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:45 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:45.631+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:45.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:45 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:45.631+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:45.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:45 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:45.631+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:46.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:45 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:45.764+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:46.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:45 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:45.764+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:46.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:45 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:45.785+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:46.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:45 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:45.785+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:46.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:45 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:45.785+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:46.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:46 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:46.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:46.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:46 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:46.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:46.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:46 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:46.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:47.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:46 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:46.785+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:47.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:46 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:46.785+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:47.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:46 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:46.790+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:47.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:46 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:46.790+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:47.053 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:46 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:46.790+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:47.053 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:46 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:46.790+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:47.143 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:46 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:46.726+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:47.143 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:46 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:46.726+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:47.143 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:46 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:46.726+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:47.143 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:46 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:46.646+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:47.143 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:46 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:46.646+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:47.143 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:46 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:46.646+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:47.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:47 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:47.391+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:47.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:47 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:47.391+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:47.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:47 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:47.391+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:47.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:47 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:47.391+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:47.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:47.734+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:47.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:47.734+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:47.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:47.734+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:47.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:47.626+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:47.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:47.626+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:47.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:47 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:47.626+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:48.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:47.805+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:14.068965+0000 front 2026-02-13T01:31:14.068946+0000 (oldest deadline 2026-02-13T01:31:39.969050+0000) 2026-02-13T01:31:48.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:47.805+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.969246+0000 front 2026-02-13T01:31:19.969321+0000 (oldest deadline 2026-02-13T01:31:41.069325+0000) 2026-02-13T01:31:48.052 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7[45139]: 2026-02-13T01:31:47.805+0000 7f66848556c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.469979+0000 front 2026-02-13T01:31:24.470082+0000 (oldest deadline 2026-02-13T01:31:47.369994+0000) 2026-02-13T01:31:48.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:47.796+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:48.052 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:47.796+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:48.053 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:47.796+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:48.053 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:47 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:47.796+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:48.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:48.416+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:48.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:48.416+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:48.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:48.416+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:48.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:48 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:48.416+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:48.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:48.585+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:48.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:48.585+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:48.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:48.585+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:48.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:48.762+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:48.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:48.762+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:48.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:48.762+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:48.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:48 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:48.762+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.495034+0000 front 2026-02-13T01:31:24.494875+0000 (oldest deadline 2026-02-13T01:31:48.594904+0000) 2026-02-13T01:31:48.990 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59420]: 2026-02-13 01:31:48.689991047 +0000 UTC m=+5.071193975 container died 91c813233fa1e72376e7c6ce5393bd00fee7495f67ef024a4d15af274bd032e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10) 2026-02-13T01:31:48.991 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59420]: 2026-02-13 01:31:48.698998062 +0000 UTC m=+5.080200990 container remove 91c813233fa1e72376e7c6ce5393bd00fee7495f67ef024a4d15af274bd032e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image) 2026-02-13T01:31:48.991 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 bash[59420]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7 2026-02-13T01:31:48.991 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59548]: 2026-02-13 01:31:48.831480678 +0000 UTC m=+0.016366799 container create 9abf9e8adbf9b5ab777c3d01eb667c28cf0a3a6143f1ebd44b696a29fd611edb (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10) 2026-02-13T01:31:48.991 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:48 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:48.844+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:48.991 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:48 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:48.844+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:48 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:48.844+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:48 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:48.844+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59548]: 2026-02-13 01:31:48.863840788 +0000 UTC m=+0.048726919 container init 9abf9e8adbf9b5ab777c3d01eb667c28cf0a3a6143f1ebd44b696a29fd611edb (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7-deactivate, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, name=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59548]: 2026-02-13 01:31:48.866507175 +0000 UTC m=+0.051393296 container start 9abf9e8adbf9b5ab777c3d01eb667c28cf0a3a6143f1ebd44b696a29fd611edb (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default) 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59548]: 2026-02-13 01:31:48.867254222 +0000 UTC m=+0.052140353 container attach 9abf9e8adbf9b5ab777c3d01eb667c28cf0a3a6143f1ebd44b696a29fd611edb (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, license=BSD-3-Clause, name=rockylinux) 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59548]: 2026-02-13 01:31:48.824691872 +0000 UTC m=+0.009578003 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:48.992 INFO:journalctl@ceph.osd.7.trial134.stdout:Feb 13 01:31:48 trial134 podman[59548]: 2026-02-13 01:31:48.992901655 +0000 UTC m=+0.177787786 container died 9abf9e8adbf9b5ab777c3d01eb667c28cf0a3a6143f1ebd44b696a29fd611edb (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:49.020 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.7.service' 2026-02-13T01:31:49.055 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:49.055 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T01:31:49.055 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T01:31:49.056 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.8 2026-02-13T01:31:49.393 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 systemd[1]: Stopping Ceph osd.8 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:49.393 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.161+0000 7f627c6386c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:49.393 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.161+0000 7f627c6386c0 -1 osd.8 79 *** Got signal Terminated *** 2026-02-13T01:31:49.393 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.161+0000 7f627c6386c0 -1 osd.8 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:49.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:49.369+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:49.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:49.369+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:49.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:49.369+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:49.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:49 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:49.369+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:49.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:49.575+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:49.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:49.575+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:49.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:49.575+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:49.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.724+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:49.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.724+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:49.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.724+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:49.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:49 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:49.724+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.495034+0000 front 2026-02-13T01:31:24.494875+0000 (oldest deadline 2026-02-13T01:31:48.594904+0000) 2026-02-13T01:31:50.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:49 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:49.815+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:50.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:49 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:49.815+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:50.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:49 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:49.815+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:50.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:49 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:49.815+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:50.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:50.400+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:50.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:50.400+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:50.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:50.400+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:50.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:50 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:50.400+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:50.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:50.582+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:50.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:50.582+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:50.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:50.582+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:50.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:50.732+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:50.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:50.732+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:50.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:50.732+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:50.895 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:50 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:50.732+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.495034+0000 front 2026-02-13T01:31:24.494875+0000 (oldest deadline 2026-02-13T01:31:48.594904+0000) 2026-02-13T01:31:51.051 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:50 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:50.786+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:51.051 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:50 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:50.786+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:51.051 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:50 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:50.786+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:51.051 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:50 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:50.786+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:51.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:51 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:51.362+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:51.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:51 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:51.362+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:51.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:51 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:51.362+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:51.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:51 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:51.362+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:51.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:51.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:51.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:51.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:51.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:51.605+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:51.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:51.729+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:51.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:51.729+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:51.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:51.729+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:51.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:51 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:51.729+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.495034+0000 front 2026-02-13T01:31:24.494875+0000 (oldest deadline 2026-02-13T01:31:48.594904+0000) 2026-02-13T01:31:52.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:51 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:51.832+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:52.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:51 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:51.832+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:52.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:51 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:51.832+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:52.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:51 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:51.832+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:52.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:52 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:52.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:52.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:52 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:52.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:52.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:52 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:52.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:52.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:52 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:52.347+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:52.559+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:52.559+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:52.559+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:52.559+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:52.769+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:52.769+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:52.769+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:52.769+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.495034+0000 front 2026-02-13T01:31:24.494875+0000 (oldest deadline 2026-02-13T01:31:48.594904+0000) 2026-02-13T01:31:52.893 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:52 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:52.769+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:28.595179+0000 front 2026-02-13T01:31:28.595242+0000 (oldest deadline 2026-02-13T01:31:52.695146+0000) 2026-02-13T01:31:53.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:52 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:52.874+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:53.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:52 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:52.874+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:53.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:52 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:52.874+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:53.303 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:52 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:52.874+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:53.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:53.370+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:53.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:53.370+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:53.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:53.370+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:53.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:53.370+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:53.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:53 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:53.370+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:53.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:53.532+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:53.532+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:53.532+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:53.532+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:53.723+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:05.893501+0000 front 2026-02-13T01:31:05.893462+0000 (oldest deadline 2026-02-13T01:31:30.593471+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:53.723+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.893964+0000 front 2026-02-13T01:31:12.893937+0000 (oldest deadline 2026-02-13T01:31:35.193947+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:53.723+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:16.894293+0000 front 2026-02-13T01:31:16.894304+0000 (oldest deadline 2026-02-13T01:31:41.594399+0000) 2026-02-13T01:31:53.894 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:53.723+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:24.495034+0000 front 2026-02-13T01:31:24.494875+0000 (oldest deadline 2026-02-13T01:31:48.594904+0000) 2026-02-13T01:31:53.895 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:53 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8[45761]: 2026-02-13T01:31:53.723+0000 7f6278cfd6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:28.595179+0000 front 2026-02-13T01:31:28.595242+0000 (oldest deadline 2026-02-13T01:31:52.695146+0000) 2026-02-13T01:31:54.301 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:53 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:53.888+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:54.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:53 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:53.888+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:54.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:53 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:53.888+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:54.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:53 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:53.888+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:54.510 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[61904]: 2026-02-13 01:31:54.231787958 +0000 UTC m=+5.082977745 container died 31d97c082d087910efb253187629d3a575c0e5d41249617ea255e0e2592e7858 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T01:31:54.510 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[61904]: 2026-02-13 01:31:54.240688587 +0000 UTC m=+5.091878364 container remove 31d97c082d087910efb253187629d3a575c0e5d41249617ea255e0e2592e7858 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, summary=Rocky Linux Base image, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default) 2026-02-13T01:31:54.511 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 bash[61904]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8 2026-02-13T01:31:54.511 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[62036]: 2026-02-13 01:31:54.371482559 +0000 UTC m=+0.016764547 container create 45c94229b2947645ed2086eb360f5cf1dbfbdc03639ce9b411e797dbff9b0d4a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, io.buildah.version=1.33.7, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:54.511 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[62036]: 2026-02-13 01:31:54.401175442 +0000 UTC m=+0.046457430 container init 45c94229b2947645ed2086eb360f5cf1dbfbdc03639ce9b411e797dbff9b0d4a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:54.511 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[62036]: 2026-02-13 01:31:54.403579231 +0000 UTC m=+0.048861219 container start 45c94229b2947645ed2086eb360f5cf1dbfbdc03639ce9b411e797dbff9b0d4a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, ceph=True, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10) 2026-02-13T01:31:54.511 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[62036]: 2026-02-13 01:31:54.404117238 +0000 UTC m=+0.049399226 container attach 45c94229b2947645ed2086eb360f5cf1dbfbdc03639ce9b411e797dbff9b0d4a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T01:31:54.511 INFO:journalctl@ceph.osd.8.trial187.stdout:Feb 13 01:31:54 trial187 podman[62036]: 2026-02-13 01:31:54.364874822 +0000 UTC m=+0.010156811 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:54.568 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.8.service' 2026-02-13T01:31:54.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:54.606 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T01:31:54.606 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T01:31:54.606 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.9 2026-02-13T01:31:54.656 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.403+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:54.656 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.403+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:54.656 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.403+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:54.656 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.403+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:54.656 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.403+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:54.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:54 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:54.511+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:54.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:54 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:54.511+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:54.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:54 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:54.511+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:54.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:54 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:54.511+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:54.946 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 systemd[1]: Stopping Ceph osd.9 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:31:54.946 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.784+0000 7f5c124686c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:54.946 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.784+0000 7f5c124686c0 -1 osd.9 79 *** Got signal Terminated *** 2026-02-13T01:31:54.947 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:54 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:54.784+0000 7f5c124686c0 -1 osd.9 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:55.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:54 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:54.907+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:55.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:54 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:54.907+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:55.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:54 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:54.907+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:55.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:54 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:54.907+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:55.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:55 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:55.373+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:55.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:55 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:55.373+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:55.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:55 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:55.373+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:55.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:55 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:55.373+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:55.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:55 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:55.373+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:55.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:55 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:55.510+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:55.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:55 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:55.510+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:55.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:55 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:55.510+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:55.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:55 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:55.510+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:56.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:55 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:55.940+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:56.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:55 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:55.940+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:56.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:55 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:55.940+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:56.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:55 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:55.940+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:56.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:56 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:56.338+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:56.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:56 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:56.338+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:56.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:56 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:56.338+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:56.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:56 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:56.338+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:56.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:56 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:56.338+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:56.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:56 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:56.523+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:56.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:56 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:56.523+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:56.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:56 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:56.523+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:56.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:56 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:56.523+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:57.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:56 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:56.944+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:57.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:56 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:56.944+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:57.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:56 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:56.944+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:57.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:56 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:56.944+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:57.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:57 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:57.344+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:57.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:57 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:57.344+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:57.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:57 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:57.344+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:57.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:57 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:57.344+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:57.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:57 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:57.344+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:57.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:57 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:57.485+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:57.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:57 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:57.485+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:57.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:57 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:57.485+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:57.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:57 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:57.485+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:58.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:57 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:57.913+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:58.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:57 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:57.913+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:58.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:57 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:57.913+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:58.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:57 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:57.913+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:58.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:57 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:57.913+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:31:58.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:58.356+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:58.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:58.356+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:58.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:58.356+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:58.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:58.356+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:58.697 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:58 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:58.356+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:58.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:58 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:58.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:58.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:58 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:58.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:58.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:58 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:58.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:58.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:58 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:58.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:31:59.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:58 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:58.897+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:31:59.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:58 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:58.897+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:31:59.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:58 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:58.897+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:31:59.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:58 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:58.897+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:31:59.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:58 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:58.897+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:31:59.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:59.364+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:08.087369+0000 front 2026-02-13T01:31:08.087554+0000 (oldest deadline 2026-02-13T01:31:30.987462+0000) 2026-02-13T01:31:59.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:59.364+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.688240+0000 front 2026-02-13T01:31:12.688265+0000 (oldest deadline 2026-02-13T01:31:35.588358+0000) 2026-02-13T01:31:59.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:59.364+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:15.588723+0000 front 2026-02-13T01:31:15.588710+0000 (oldest deadline 2026-02-13T01:31:41.488816+0000) 2026-02-13T01:31:59.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:59.364+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:23.089666+0000 front 2026-02-13T01:31:23.089742+0000 (oldest deadline 2026-02-13T01:31:47.189822+0000) 2026-02-13T01:31:59.696 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9[51727]: 2026-02-13T01:31:59.364+0000 7f5c0ab256c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:27.190170+0000 front 2026-02-13T01:31:27.190214+0000 (oldest deadline 2026-02-13T01:31:52.490081+0000) 2026-02-13T01:31:59.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:59 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:59.449+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:31:59.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:59 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:59.449+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:31:59.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:59 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:59.449+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:31:59.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:31:59 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:31:59.449+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:00.154 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 podman[72653]: 2026-02-13 01:31:59.859694079 +0000 UTC m=+5.098211194 container died d249f8bf809ee766f1d55e8613a2ae653272eedda6862b9988e7aa3b350114fd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, ceph=True, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:32:00.154 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 podman[72653]: 2026-02-13 01:31:59.918010255 +0000 UTC m=+5.156527370 container remove d249f8bf809ee766f1d55e8613a2ae653272eedda6862b9988e7aa3b350114fd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, version=10, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:32:00.154 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:31:59 trial028 bash[72653]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9 2026-02-13T01:32:00.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:59 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:59.883+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:32:00.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:59 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:59.883+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:32:00.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:59 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:59.883+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:32:00.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:59 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:59.883+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:32:00.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:31:59 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:31:59.883+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:32:00.422 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:32:00 trial028 podman[72757]: 2026-02-13 01:32:00.154443178 +0000 UTC m=+0.026901087 container create 7ce3e423203aeea3fcdd02ddcdc98c6a68422c708a00b3e759ed79a1e84b471f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.title=rockylinux) 2026-02-13T01:32:00.422 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:32:00 trial028 podman[72757]: 2026-02-13 01:32:00.204100501 +0000 UTC m=+0.076558420 container init 7ce3e423203aeea3fcdd02ddcdc98c6a68422c708a00b3e759ed79a1e84b471f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:32:00.422 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:32:00 trial028 podman[72757]: 2026-02-13 01:32:00.209334621 +0000 UTC m=+0.081792550 container start 7ce3e423203aeea3fcdd02ddcdc98c6a68422c708a00b3e759ed79a1e84b471f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.version=10) 2026-02-13T01:32:00.429 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:32:00 trial028 podman[72757]: 2026-02-13 01:32:00.210217249 +0000 UTC m=+0.082675168 container attach 7ce3e423203aeea3fcdd02ddcdc98c6a68422c708a00b3e759ed79a1e84b471f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T01:32:00.429 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:32:00 trial028 podman[72757]: 2026-02-13 01:32:00.145071713 +0000 UTC m=+0.017529642 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:32:00.429 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 13 01:32:00 trial028 podman[72757]: 2026-02-13 01:32:00.391170558 +0000 UTC m=+0.263628467 container died 7ce3e423203aeea3fcdd02ddcdc98c6a68422c708a00b3e759ed79a1e84b471f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux) 2026-02-13T01:32:00.476 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.9.service' 2026-02-13T01:32:00.545 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:00.545 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T01:32:00.545 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T01:32:00.546 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.10 2026-02-13T01:32:00.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:00 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:00.457+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:00.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:00 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:00.457+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:00.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:00 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:00.457+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:00.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:00 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:00.457+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:00.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:00 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:00.457+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 systemd[1]: Stopping Ceph osd.10 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.645+0000 7f440258a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.645+0000 7f440258a6c0 -1 osd.10 79 *** Got signal Terminated *** 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.645+0000 7f440258a6c0 -1 osd.10 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.917+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.917+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.917+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.917+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:32:00.915 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:00 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:00.917+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:32:01.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:01 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:01.461+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:01.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:01 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:01.461+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:01.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:01 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:01.461+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:01.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:01 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:01.461+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:01.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:01 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:01.461+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:02.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:01.902+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:32:02.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:01.902+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:32:02.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:01.902+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:32:02.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:01.902+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:32:02.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:01 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:01.902+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:32:02.794 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:02.438+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:02.794 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:02.438+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:02.795 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:02.438+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:02.795 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:02.438+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:02.795 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:02 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:02.438+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:03.203 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:02 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:02.919+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:32:03.203 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:02 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:02.919+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:32:03.203 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:02 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:02.919+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:32:03.203 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:02 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:02.919+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:32:03.203 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:02 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:02.919+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:32:03.204 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:02 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:02.919+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.969835+0000 front 2026-02-13T01:31:36.969886+0000 (oldest deadline 2026-02-13T01:32:02.269819+0000) 2026-02-13T01:32:03.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:03 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:03.481+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:03.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:03 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:03.481+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:03.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:03 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:03.481+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:03.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:03 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:03.481+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:03.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:03 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:03.481+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:04.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:03 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:03.901+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:32:04.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:03 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:03.901+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:32:04.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:03 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:03.901+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:32:04.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:03 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:03.901+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:32:04.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:03 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:03.901+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:32:04.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:03 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:03.901+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.969835+0000 front 2026-02-13T01:31:36.969886+0000 (oldest deadline 2026-02-13T01:32:02.269819+0000) 2026-02-13T01:32:04.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:04 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:04.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:04.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:04 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:04.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:04.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:04 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:04.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:04.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:04 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:04.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:04.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:04 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:04.448+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:05.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:04 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:04.933+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:04.467496+0000 front 2026-02-13T01:31:04.467669+0000 (oldest deadline 2026-02-13T01:31:29.767563+0000) 2026-02-13T01:32:05.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:04 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:04.933+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:09.767732+0000 front 2026-02-13T01:31:09.767748+0000 (oldest deadline 2026-02-13T01:31:35.067845+0000) 2026-02-13T01:32:05.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:04 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:04.933+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:17.368345+0000 front 2026-02-13T01:31:17.368355+0000 (oldest deadline 2026-02-13T01:31:42.668365+0000) 2026-02-13T01:32:05.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:04 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:04.933+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-13T01:31:25.369087+0000 front 2026-02-13T01:31:25.369245+0000 (oldest deadline 2026-02-13T01:31:45.869075+0000) 2026-02-13T01:32:05.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:04 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:04.933+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:31.069540+0000 front 2026-02-13T01:31:31.069557+0000 (oldest deadline 2026-02-13T01:31:56.969604+0000) 2026-02-13T01:32:05.302 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:04 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10[51366]: 2026-02-13T01:32:04.933+0000 7f43fec4f6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.969835+0000 front 2026-02-13T01:31:36.969886+0000 (oldest deadline 2026-02-13T01:32:02.269819+0000) 2026-02-13T01:32:05.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:05 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:05.431+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:05.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:05 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:05.431+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:05.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:05 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:05.431+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:05.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:05 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:05.431+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:05.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:05 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:05.431+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:05.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:05 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:05.431+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-13T01:31:39.991414+0000 front 2026-02-13T01:31:39.991397+0000 (oldest deadline 2026-02-13T01:32:05.291323+0000) 2026-02-13T01:32:05.989 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59689]: 2026-02-13 01:32:05.704771724 +0000 UTC m=+5.072180626 container died 65d0dc2d4948552e5351a1f7ff3dea911f824b346d6ac86b27444c792c6dac87 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, license=BSD-3-Clause, name=rockylinux, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, OSD_FLAVOR=default) 2026-02-13T01:32:05.989 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59689]: 2026-02-13 01:32:05.713279425 +0000 UTC m=+5.080688327 container remove 65d0dc2d4948552e5351a1f7ff3dea911f824b346d6ac86b27444c792c6dac87 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:32:05.989 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 bash[59689]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10 2026-02-13T01:32:05.989 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59820]: 2026-02-13 01:32:05.841661223 +0000 UTC m=+0.016066098 container create 03ec2e89441994a41016a92ffd0b040ca29163c71386bfe7a6415e8330f188ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10) 2026-02-13T01:32:05.990 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59820]: 2026-02-13 01:32:05.869773127 +0000 UTC m=+0.044177992 container init 03ec2e89441994a41016a92ffd0b040ca29163c71386bfe7a6415e8330f188ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10-deactivate, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:32:05.990 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59820]: 2026-02-13 01:32:05.872562484 +0000 UTC m=+0.046967349 container start 03ec2e89441994a41016a92ffd0b040ca29163c71386bfe7a6415e8330f188ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:32:05.990 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59820]: 2026-02-13 01:32:05.873022594 +0000 UTC m=+0.047427479 container attach 03ec2e89441994a41016a92ffd0b040ca29163c71386bfe7a6415e8330f188ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10-deactivate, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:32:05.990 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59820]: 2026-02-13 01:32:05.835354017 +0000 UTC m=+0.009758902 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:32:05.990 INFO:journalctl@ceph.osd.10.trial134.stdout:Feb 13 01:32:05 trial134 podman[59820]: 2026-02-13 01:32:05.991646302 +0000 UTC m=+0.166051187 container died 03ec2e89441994a41016a92ffd0b040ca29163c71386bfe7a6415e8330f188ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, version=10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, ceph=True) 2026-02-13T01:32:06.021 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.10.service' 2026-02-13T01:32:06.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:06.058 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T01:32:06.058 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T01:32:06.058 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.11 2026-02-13T01:32:06.393 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 systemd[1]: Stopping Ceph osd.11 for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:06.393 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.160+0000 7f4de551d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:32:06.393 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.160+0000 7f4de551d6c0 -1 osd.11 79 *** Got signal Terminated *** 2026-02-13T01:32:06.393 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.160+0000 7f4de551d6c0 -1 osd.11 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:32:06.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.452+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:06.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.452+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:06.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.452+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:06.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.452+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:06.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.452+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:06.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:06 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:06.452+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-13T01:31:39.991414+0000 front 2026-02-13T01:31:39.991397+0000 (oldest deadline 2026-02-13T01:32:05.291323+0000) 2026-02-13T01:32:07.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:07 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:07.501+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:07.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:07 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:07.501+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:07.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:07 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:07.501+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:07.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:07 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:07.501+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:07.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:07 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:07.501+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:07.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:07 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:07.501+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-13T01:31:39.991414+0000 front 2026-02-13T01:31:39.991397+0000 (oldest deadline 2026-02-13T01:32:05.291323+0000) 2026-02-13T01:32:08.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:08 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:08.456+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:08.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:08 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:08.456+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:08.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:08 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:08.456+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:08.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:08 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:08.456+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:08.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:08 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:08.456+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:08.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:08 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:08.456+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-13T01:31:39.991414+0000 front 2026-02-13T01:31:39.991397+0000 (oldest deadline 2026-02-13T01:32:05.291323+0000) 2026-02-13T01:32:09.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:09 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:09.454+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:09.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:09 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:09.454+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:09.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:09 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:09.454+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:09.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:09 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:09.454+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:09.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:09 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:09.454+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:09.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:09 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:09.454+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-13T01:31:39.991414+0000 front 2026-02-13T01:31:39.991397+0000 (oldest deadline 2026-02-13T01:32:05.291323+0000) 2026-02-13T01:32:10.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-13T01:31:06.289091+0000 front 2026-02-13T01:31:06.289065+0000 (oldest deadline 2026-02-13T01:31:32.189033+0000) 2026-02-13T01:32:10.893 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6804 osd.1 since back 2026-02-13T01:31:12.689456+0000 front 2026-02-13T01:31:12.689379+0000 (oldest deadline 2026-02-13T01:31:36.789469+0000) 2026-02-13T01:32:10.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6804 osd.2 since back 2026-02-13T01:31:19.089763+0000 front 2026-02-13T01:31:19.089777+0000 (oldest deadline 2026-02-13T01:31:40.189874+0000) 2026-02-13T01:32:10.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6812 osd.4 since back 2026-02-13T01:31:26.590458+0000 front 2026-02-13T01:31:26.590519+0000 (oldest deadline 2026-02-13T01:31:51.890462+0000) 2026-02-13T01:32:10.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.187:6812 osd.5 since back 2026-02-13T01:31:36.490935+0000 front 2026-02-13T01:31:36.490946+0000 (oldest deadline 2026-02-13T01:31:59.991091+0000) 2026-02-13T01:32:10.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-13T01:31:39.991414+0000 front 2026-02-13T01:31:39.991397+0000 (oldest deadline 2026-02-13T01:32:05.291323+0000) 2026-02-13T01:32:10.894 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:10 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11[52154]: 2026-02-13T01:32:10.490+0000 7f4de1be26c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.134:6820 osd.7 since back 2026-02-13T01:31:45.291552+0000 front 2026-02-13T01:31:45.291542+0000 (oldest deadline 2026-02-13T01:32:09.991519+0000) 2026-02-13T01:32:11.523 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62169]: 2026-02-13 01:32:11.230493505 +0000 UTC m=+5.082479553 container died 7359d8574f4525f693156a7ccda622030808f0eb30d31bfeb0c1552f81fed36b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62169]: 2026-02-13 01:32:11.238980449 +0000 UTC m=+5.090966497 container remove 7359d8574f4525f693156a7ccda622030808f0eb30d31bfeb0c1552f81fed36b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause) 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 bash[62169]: ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62307]: 2026-02-13 01:32:11.364629252 +0000 UTC m=+0.014476004 container create 7cc1f0d7c374f438023200bb3c6b4360a289c252eeba0c20d968618079f13cb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11-deactivate, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62307]: 2026-02-13 01:32:11.39442122 +0000 UTC m=+0.044267992 container init 7cc1f0d7c374f438023200bb3c6b4360a289c252eeba0c20d968618079f13cb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11-deactivate, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image) 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62307]: 2026-02-13 01:32:11.396897024 +0000 UTC m=+0.046743786 container start 7cc1f0d7c374f438023200bb3c6b4360a289c252eeba0c20d968618079f13cb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62307]: 2026-02-13 01:32:11.397470106 +0000 UTC m=+0.047316869 container attach 7cc1f0d7c374f438023200bb3c6b4360a289c252eeba0c20d968618079f13cb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11-deactivate, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux) 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62307]: 2026-02-13 01:32:11.359003693 +0000 UTC m=+0.008850465 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:32:11.524 INFO:journalctl@ceph.osd.11.trial187.stdout:Feb 13 01:32:11 trial187 podman[62307]: 2026-02-13 01:32:11.526203733 +0000 UTC m=+0.176050495 container died 7cc1f0d7c374f438023200bb3c6b4360a289c252eeba0c20d968618079f13cb5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-70ced355-087a-11f1-9708-d404e6e7d460-osd-11-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, name=rockylinux, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default) 2026-02-13T01:32:11.571 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@osd.11.service' 2026-02-13T01:32:11.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:11.607 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T01:32:11.607 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T01:32:11.607 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.a 2026-02-13T01:32:11.946 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 13 01:32:11 trial028 systemd[1]: Stopping Ceph mds.a for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:11.946 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 13 01:32:11 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-a[57139]: 2026-02-13T01:32:11.787+0000 7fb1506aa6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:11.947 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 13 01:32:11 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-a[57139]: 2026-02-13T01:32:11.787+0000 7fb1506aa6c0 -1 mds.a *** got signal Terminated *** 2026-02-13T01:32:12.908 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.a.service' 2026-02-13T01:32:12.975 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:12.975 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T01:32:12.976 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T01:32:12.976 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.d 2026-02-13T01:32:13.446 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:32:13 trial028 systemd[1]: Stopping Ceph mds.d for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:13.446 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:32:13 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-d[56301]: 2026-02-13T01:32:13.153+0000 7ffb869416c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:13.446 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 13 01:32:13 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-d[56301]: 2026-02-13T01:32:13.153+0000 7ffb869416c0 -1 mds.d *** got signal Terminated *** 2026-02-13T01:32:14.283 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.d.service' 2026-02-13T01:32:14.350 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:14.351 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T01:32:14.351 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T01:32:14.351 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.g 2026-02-13T01:32:14.696 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:32:14 trial028 systemd[1]: Stopping Ceph mds.g for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:14.696 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:32:14 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-g[56766]: 2026-02-13T01:32:14.560+0000 7f8f958016c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:14.696 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 13 01:32:14 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-g[56766]: 2026-02-13T01:32:14.560+0000 7f8f958016c0 -1 mds.g *** got signal Terminated *** 2026-02-13T01:32:15.684 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.g.service' 2026-02-13T01:32:15.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:15.749 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T01:32:15.749 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T01:32:15.749 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.j 2026-02-13T01:32:16.196 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 13 01:32:15 trial028 systemd[1]: Stopping Ceph mds.j for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:16.196 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 13 01:32:15 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-j[56008]: 2026-02-13T01:32:15.925+0000 7f12c9fc86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:16.197 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 13 01:32:15 trial028 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-j[56008]: 2026-02-13T01:32:15.925+0000 7f12c9fc86c0 -1 mds.j *** got signal Terminated *** 2026-02-13T01:32:17.257 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.j.service' 2026-02-13T01:32:17.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:17.324 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T01:32:17.324 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T01:32:17.325 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.b 2026-02-13T01:32:17.802 INFO:journalctl@ceph.mds.b.trial134.stdout:Feb 13 01:32:17 trial134 systemd[1]: Stopping Ceph mds.b for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:17.802 INFO:journalctl@ceph.mds.b.trial134.stdout:Feb 13 01:32:17 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-b[56241]: 2026-02-13T01:32:17.419+0000 7f72260726c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:17.802 INFO:journalctl@ceph.mds.b.trial134.stdout:Feb 13 01:32:17 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-b[56241]: 2026-02-13T01:32:17.419+0000 7f72260726c0 -1 mds.b *** got signal Terminated *** 2026-02-13T01:32:20.091 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.b.service' 2026-02-13T01:32:20.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:20.126 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T01:32:20.126 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T01:32:20.127 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.e 2026-02-13T01:32:20.260 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:32:20 trial134 systemd[1]: Stopping Ceph mds.e for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:20.551 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:32:20 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-e[55593]: 2026-02-13T01:32:20.262+0000 7f9f2e6bd6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:20.552 INFO:journalctl@ceph.mds.e.trial134.stdout:Feb 13 01:32:20 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-e[55593]: 2026-02-13T01:32:20.262+0000 7f9f2e6bd6c0 -1 mds.e *** got signal Terminated *** 2026-02-13T01:32:21.295 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.e.service' 2026-02-13T01:32:21.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:21.327 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T01:32:21.327 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T01:32:21.327 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.h 2026-02-13T01:32:21.551 INFO:journalctl@ceph.mds.h.trial134.stdout:Feb 13 01:32:21 trial134 systemd[1]: Stopping Ceph mds.h for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:21.552 INFO:journalctl@ceph.mds.h.trial134.stdout:Feb 13 01:32:21 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-h[55917]: 2026-02-13T01:32:21.460+0000 7ff71e5256c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:21.552 INFO:journalctl@ceph.mds.h.trial134.stdout:Feb 13 01:32:21 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-h[55917]: 2026-02-13T01:32:21.460+0000 7ff71e5256c0 -1 mds.h *** got signal Terminated *** 2026-02-13T01:32:22.515 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.h.service' 2026-02-13T01:32:22.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:22.548 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T01:32:22.548 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T01:32:22.548 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.k 2026-02-13T01:32:22.801 INFO:journalctl@ceph.mds.k.trial134.stdout:Feb 13 01:32:22 trial134 systemd[1]: Stopping Ceph mds.k for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:22.802 INFO:journalctl@ceph.mds.k.trial134.stdout:Feb 13 01:32:22 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-k[55267]: 2026-02-13T01:32:22.681+0000 7fe79faf06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:22.802 INFO:journalctl@ceph.mds.k.trial134.stdout:Feb 13 01:32:22 trial134 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-k[55267]: 2026-02-13T01:32:22.681+0000 7fe79faf06c0 -1 mds.k *** got signal Terminated *** 2026-02-13T01:32:23.701 DEBUG:teuthology.orchestra.run.trial134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.k.service' 2026-02-13T01:32:23.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:23.734 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T01:32:23.734 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T01:32:23.734 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.c 2026-02-13T01:32:24.143 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:32:23 trial187 systemd[1]: Stopping Ceph mds.c for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:24.143 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:32:23 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-c[57184]: 2026-02-13T01:32:23.837+0000 7fbb590786c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:24.144 INFO:journalctl@ceph.mds.c.trial187.stdout:Feb 13 01:32:23 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-c[57184]: 2026-02-13T01:32:23.837+0000 7fbb590786c0 -1 mds.c *** got signal Terminated *** 2026-02-13T01:32:25.083 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.c.service' 2026-02-13T01:32:25.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:25.117 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T01:32:25.117 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T01:32:25.117 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.f 2026-02-13T01:32:25.393 INFO:journalctl@ceph.mds.f.trial187.stdout:Feb 13 01:32:25 trial187 systemd[1]: Stopping Ceph mds.f for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:25.393 INFO:journalctl@ceph.mds.f.trial187.stdout:Feb 13 01:32:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-f[56858]: 2026-02-13T01:32:25.257+0000 7f8140c7b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:25.393 INFO:journalctl@ceph.mds.f.trial187.stdout:Feb 13 01:32:25 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-f[56858]: 2026-02-13T01:32:25.257+0000 7f8140c7b6c0 -1 mds.f *** got signal Terminated *** 2026-02-13T01:32:26.353 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.f.service' 2026-02-13T01:32:26.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:26.388 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T01:32:26.388 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T01:32:26.389 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.i 2026-02-13T01:32:26.643 INFO:journalctl@ceph.mds.i.trial187.stdout:Feb 13 01:32:26 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-i[57506]: 2026-02-13T01:32:26.526+0000 7f148c9786c0 -1 mds.i *** got signal Terminated *** 2026-02-13T01:32:32.399 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.i.service' 2026-02-13T01:32:32.431 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:32.432 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T01:32:32.432 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T01:32:32.432 DEBUG:teuthology.orchestra.run.trial187:> sudo systemctl stop ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.l 2026-02-13T01:32:32.570 INFO:journalctl@ceph.mds.l.trial187.stdout:Feb 13 01:32:32 trial187 systemd[1]: Stopping Ceph mds.l for 70ced355-087a-11f1-9708-d404e6e7d460... 2026-02-13T01:32:32.893 INFO:journalctl@ceph.mds.l.trial187.stdout:Feb 13 01:32:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-l[56535]: 2026-02-13T01:32:32.572+0000 7f528a02d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:32.893 INFO:journalctl@ceph.mds.l.trial187.stdout:Feb 13 01:32:32 trial187 ceph-70ced355-087a-11f1-9708-d404e6e7d460-mds-l[56535]: 2026-02-13T01:32:32.572+0000 7f528a02d6c0 -1 mds.l *** got signal Terminated *** 2026-02-13T01:32:33.598 DEBUG:teuthology.orchestra.run.trial187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-70ced355-087a-11f1-9708-d404e6e7d460@mds.l.service' 2026-02-13T01:32:33.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:33.635 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T01:32:33.635 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --force --keep-logs 2026-02-13T01:32:33.820 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:32:36.931 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --force --keep-logs 2026-02-13T01:32:37.049 INFO:teuthology.orchestra.run.trial134.stdout:Deleting cluster with fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:32:38.846 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --force --keep-logs 2026-02-13T01:32:38.965 INFO:teuthology.orchestra.run.trial187.stdout:Deleting cluster with fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:32:40.795 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:32:40.856 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:32:40.885 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:32:40.914 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T01:32:40.916 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial028/crash 2026-02-13T01:32:40.917 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash -- . 2026-02-13T01:32:40.971 INFO:teuthology.orchestra.run.trial028.stderr:tar: /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:32:40.971 INFO:teuthology.orchestra.run.trial028.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:32:40.975 DEBUG:teuthology.misc:Transferring archived files from trial134:/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial134/crash 2026-02-13T01:32:40.976 DEBUG:teuthology.orchestra.run.trial134:> sudo tar c -f - -C /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash -- . 2026-02-13T01:32:41.003 INFO:teuthology.orchestra.run.trial134.stderr:tar: /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:32:41.003 INFO:teuthology.orchestra.run.trial134.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:32:41.005 DEBUG:teuthology.misc:Transferring archived files from trial187:/var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial187/crash 2026-02-13T01:32:41.006 DEBUG:teuthology.orchestra.run.trial187:> sudo tar c -f - -C /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash -- . 2026-02-13T01:32:41.032 INFO:teuthology.orchestra.run.trial187.stderr:tar: /var/lib/ceph/70ced355-087a-11f1-9708-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:32:41.032 INFO:teuthology.orchestra.run.trial187.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:32:41.033 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T01:32:41.033 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:32:41.095 INFO:teuthology.orchestra.run.trial028.stdout:2026-02-13T01:23:35.918503+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:32:41.095 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T01:32:41.096 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[SEC\]' /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:32:41.159 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[ERR\]' /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:32:41.221 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[WRN\]' /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T01:32:41.285 INFO:teuthology.orchestra.run.trial028.stdout:2026-02-13T01:23:35.918503+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:32:41.287 INFO:tasks.cephadm:Compressing logs... 2026-02-13T01:32:41.287 DEBUG:teuthology.orchestra.run.trial028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:41.291 DEBUG:teuthology.orchestra.run.trial134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:41.294 DEBUG:teuthology.orchestra.run.trial187:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:41.318 INFO:teuthology.orchestra.run.trial134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:32:41.318 INFO:teuthology.orchestra.run.trial134.stderr:: No such file or directory 2026-02-13T01:32:41.318 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.y.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.b.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.h.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.y.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.7.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.10.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.4.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log 2026-02-13T01:32:41.319 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.10.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.b.log 2026-02-13T01:32:41.323 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.1.log 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr: 92.3% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.k.log 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.e.log 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.e.log: 86.6% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log.gz 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr: 94.8% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T01:32:41.324 INFO:teuthology.orchestra.run.trial134.stderr: 94.8% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T01:32:41.326 INFO:teuthology.orchestra.run.trial134.stderr: 93.3% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:32:41.327 INFO:teuthology.orchestra.run.trial187.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:32:41.327 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:32:41.327 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.2.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose --/var/log/ceph/cephadm.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.i.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.c.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.f.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.5.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.c.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.11.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.5.log: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.z.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.l.log 2026-02-13T01:32:41.328 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.c.log 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.8.log 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log: 91.1% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.8.log: 86.6% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log.gz 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr: 94.9% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr: 92.2% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T01:32:41.329 INFO:teuthology.orchestra.run.trial187.stderr: 93.9% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:32:41.330 INFO:teuthology.orchestra.run.trial134.stderr: 94.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T01:32:41.330 INFO:teuthology.orchestra.run.trial134.stderr: 95.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T01:32:41.331 INFO:teuthology.orchestra.run.trial187.stderr: 94.4% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T01:32:41.333 INFO:teuthology.orchestra.run.trial187.stderr: 94.6% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T01:32:41.342 INFO:teuthology.orchestra.run.trial028.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:32:41.342 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:32:41.342 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.a.log 2026-02-13T01:32:41.343 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.d.log 2026-02-13T01:32:41.344 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.j.log 2026-02-13T01:32:41.344 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.0.log 2026-02-13T01:32:41.345 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.3.log 2026-02-13T01:32:41.346 INFO:teuthology.orchestra.run.trial028.stderr: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:32:41.347 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:32:41.347 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.0.log: 95.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T01:32:41.347 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.a.log 2026-02-13T01:32:41.348 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.g.log 2026-02-13T01:32:41.348 INFO:teuthology.orchestra.run.trial028.stderr: 44.2% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:32:41.348 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log 2026-02-13T01:32:41.350 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.g.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log: 94.8% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T01:32:41.351 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log 2026-02-13T01:32:41.351 INFO:teuthology.orchestra.run.trial028.stderr: 94.9% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T01:32:41.351 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.6.log 2026-02-13T01:32:41.352 INFO:teuthology.orchestra.run.trial187.stderr: 93.4% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T01:32:41.352 INFO:teuthology.orchestra.run.trial028.stderr: 90.9% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:32:41.352 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.x.log 2026-02-13T01:32:41.353 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log 2026-02-13T01:32:41.354 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.9.log 2026-02-13T01:32:41.355 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log: /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.9.log: 86.6% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph.log.gz 2026-02-13T01:32:41.356 INFO:teuthology.orchestra.run.trial028.stderr: 95.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T01:32:41.357 INFO:teuthology.orchestra.run.trial028.stderr: 93.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:32:41.418 INFO:teuthology.orchestra.run.trial187.stderr: 92.0% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T01:32:41.420 INFO:teuthology.orchestra.run.trial134.stderr: 91.9% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T01:32:41.452 INFO:teuthology.orchestra.run.trial028.stderr: 90.1% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T01:32:41.453 INFO:teuthology.orchestra.run.trial187.stderr: 92.8% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T01:32:41.483 INFO:teuthology.orchestra.run.trial134.stderr: 92.2% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T01:32:41.487 INFO:teuthology.orchestra.run.trial187.stderr: 92.5% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T01:32:41.493 INFO:teuthology.orchestra.run.trial134.stderr: 92.5% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T01:32:41.507 INFO:teuthology.orchestra.run.trial028.stderr: 92.3% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T01:32:41.509 INFO:teuthology.orchestra.run.trial187.stderr: 92.3% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T01:32:41.519 INFO:teuthology.orchestra.run.trial028.stderr: 92.4% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T01:32:41.526 INFO:teuthology.orchestra.run.trial134.stderr: 92.2% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T01:32:41.527 INFO:teuthology.orchestra.run.trial028.stderr: 92.5% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T01:32:41.537 INFO:teuthology.orchestra.run.trial028.stderr: 92.2% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T01:32:41.539 INFO:teuthology.orchestra.run.trial134.stderr: 92.3% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T01:32:41.540 INFO:teuthology.orchestra.run.trial187.stderr: 92.2% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T01:32:41.541 INFO:teuthology.orchestra.run.trial134.stderr: 2026-02-13T01:32:41.542 INFO:teuthology.orchestra.run.trial134.stderr:real 0m0.233s 2026-02-13T01:32:41.542 INFO:teuthology.orchestra.run.trial134.stderr:user 0m0.860s 2026-02-13T01:32:41.542 INFO:teuthology.orchestra.run.trial134.stderr:sys 0m0.070s 2026-02-13T01:32:41.543 INFO:teuthology.orchestra.run.trial187.stderr: 2026-02-13T01:32:41.543 INFO:teuthology.orchestra.run.trial187.stderr:real 0m0.231s 2026-02-13T01:32:41.543 INFO:teuthology.orchestra.run.trial187.stderr:user 0m0.829s 2026-02-13T01:32:41.543 INFO:teuthology.orchestra.run.trial187.stderr:sys 0m0.069s 2026-02-13T01:32:41.667 INFO:teuthology.orchestra.run.trial028.stderr: 90.1% -- replaced with /var/log/ceph/70ced355-087a-11f1-9708-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T01:32:41.670 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-13T01:32:41.670 INFO:teuthology.orchestra.run.trial028.stderr:real 0m0.346s 2026-02-13T01:32:41.670 INFO:teuthology.orchestra.run.trial028.stderr:user 0m1.020s 2026-02-13T01:32:41.670 INFO:teuthology.orchestra.run.trial028.stderr:sys 0m0.175s 2026-02-13T01:32:41.672 INFO:tasks.cephadm:Archiving logs... 2026-02-13T01:32:41.672 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial028/log 2026-02-13T01:32:41.673 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:32:41.903 DEBUG:teuthology.misc:Transferring archived files from trial134:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial134/log 2026-02-13T01:32:41.904 DEBUG:teuthology.orchestra.run.trial134:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:32:42.019 DEBUG:teuthology.misc:Transferring archived files from trial187:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial187/log 2026-02-13T01:32:42.020 DEBUG:teuthology.orchestra.run.trial187:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:32:42.132 INFO:tasks.cephadm:Removing cluster... 2026-02-13T01:32:42.132 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --force 2026-02-13T01:32:42.319 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:32:42.586 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --force 2026-02-13T01:32:42.704 INFO:teuthology.orchestra.run.trial134.stdout:Deleting cluster with fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:32:42.870 DEBUG:teuthology.orchestra.run.trial187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 70ced355-087a-11f1-9708-d404e6e7d460 --force 2026-02-13T01:32:42.989 INFO:teuthology.orchestra.run.trial187.stdout:Deleting cluster with fsid: 70ced355-087a-11f1-9708-d404e6e7d460 2026-02-13T01:32:43.153 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T01:32:43.153 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:32:43.193 DEBUG:teuthology.orchestra.run.trial134:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:32:43.212 DEBUG:teuthology.orchestra.run.trial187:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:32:43.231 INFO:tasks.cephadm:Teardown complete 2026-02-13T01:32:43.231 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T01:32:43.234 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T01:32:43.248 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T01:32:43.266 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T01:32:43.266 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:32:43.270 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:32:43.273 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:32:43.534 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T01:32:43.546 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T01:32:43.546 DEBUG:teuthology.orchestra.run.trial028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:32:43.549 DEBUG:teuthology.orchestra.run.trial134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:32:43.552 DEBUG:teuthology.orchestra.run.trial187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:32:43.566 INFO:teuthology.orchestra.run.trial134.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:32:43.568 INFO:teuthology.orchestra.run.trial187.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:32:43.582 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:32:43.605 INFO:teuthology.orchestra.run.trial187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:32:43.605 INFO:teuthology.orchestra.run.trial187.stdout:=============================================================================== 2026-02-13T01:32:43.605 INFO:teuthology.orchestra.run.trial187.stdout:^* 172-238-164-57.ip.linode> 4 6 377 5 -335us[ -285us] +/- 33ms 2026-02-13T01:32:43.605 INFO:teuthology.orchestra.run.trial187.stdout:^+ time2.beanman.net 2 6 377 6 +3848us[+3898us] +/- 42ms 2026-02-13T01:32:43.605 INFO:teuthology.orchestra.run.trial187.stdout:^+ 172-234-25-10.ip.linodeu> 2 6 377 5 -3546us[-3546us] +/- 76ms 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial187.stdout:^+ 172-104-28-175.ip.linode> 2 6 377 5 -2056us[-2056us] +/- 58ms 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial134.stdout:=============================================================================== 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial134.stdout:^* 172-238-164-57.ip.linode> 4 6 377 5 -341us[ -370us] +/- 33ms 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial134.stdout:^+ time2.beanman.net 2 6 377 5 +3810us[+3810us] +/- 42ms 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial134.stdout:^+ 172-234-25-10.ip.linodeu> 2 6 377 4 -3712us[-3712us] +/- 76ms 2026-02-13T01:32:43.606 INFO:teuthology.orchestra.run.trial134.stdout:^+ 172-104-28-175.ip.linode> 2 6 377 7 -2089us[-2116us] +/- 58ms 2026-02-13T01:32:43.681 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:32:43.681 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-13T01:32:43.682 INFO:teuthology.orchestra.run.trial028.stdout:^+ europa.ellipse.net 2 6 377 5 +607us[ +618us] +/- 62ms 2026-02-13T01:32:43.682 INFO:teuthology.orchestra.run.trial028.stdout:^* 149.28.200.179.vultruser> 2 6 377 4 +1010us[+1021us] +/- 42ms 2026-02-13T01:32:43.682 INFO:teuthology.orchestra.run.trial028.stdout:^+ ntp.nexcess.net 3 6 377 3 +1714us[+1714us] +/- 50ms 2026-02-13T01:32:43.682 INFO:teuthology.orchestra.run.trial028.stdout:^+ 172-104-28-175.ip.linode> 2 6 377 4 -4670us[-4658us] +/- 58ms 2026-02-13T01:32:43.682 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T01:32:43.694 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T01:32:43.694 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T01:32:43.707 DEBUG:teuthology.orchestra.run.trial028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:32:43.822 DEBUG:teuthology.orchestra.run.trial134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:32:43.868 DEBUG:teuthology.orchestra.run.trial187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:32:43.916 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:32:43.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:43.975 DEBUG:teuthology.orchestra.run.trial134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:32:44.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:44.003 DEBUG:teuthology.orchestra.run.trial187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:32:44.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:44.029 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T01:32:44.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T01:32:44.059 INFO:teuthology.task.internal:Duration was 816.712261 seconds 2026-02-13T01:32:44.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T01:32:44.077 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T01:32:44.077 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:32:44.080 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:32:44.082 DEBUG:teuthology.orchestra.run.trial187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:32:44.118 INFO:teuthology.orchestra.run.trial134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:32:44.119 INFO:teuthology.orchestra.run.trial187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:32:44.159 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:32:44.588 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T01:32:44.588 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial028.front.sepia.ceph.com 2026-02-13T01:32:44.589 DEBUG:teuthology.orchestra.run.trial028:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:32:44.634 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial134.front.sepia.ceph.com 2026-02-13T01:32:44.634 DEBUG:teuthology.orchestra.run.trial134:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:32:44.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial187.front.sepia.ceph.com 2026-02-13T01:32:44.655 DEBUG:teuthology.orchestra.run.trial187:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:32:44.676 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T01:32:44.676 DEBUG:teuthology.orchestra.run.trial028:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:44.680 DEBUG:teuthology.orchestra.run.trial134:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:44.697 DEBUG:teuthology.orchestra.run.trial187:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:44.988 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T01:32:44.988 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:44.992 DEBUG:teuthology.orchestra.run.trial134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:44.995 DEBUG:teuthology.orchestra.run.trial187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:45.018 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:32:45.019 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:32:45.019 INFO:teuthology.orchestra.run.trial134.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:45.019 INFO:teuthology.orchestra.run.trial134.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:32:45.019 INFO:teuthology.orchestra.run.trial134.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:32:45.020 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:32:45.021 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:32:45.021 INFO:teuthology.orchestra.run.trial187.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:32:45.022 INFO:teuthology.orchestra.run.trial187.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:45.022 INFO:teuthology.orchestra.run.trial187.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:32:45.031 INFO:teuthology.orchestra.run.trial134.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:32:45.036 INFO:teuthology.orchestra.run.trial187.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:32:45.043 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:32:45.043 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:32:45.044 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:32:45.044 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:45.045 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:32:45.099 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:32:45.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T01:32:45.119 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T01:32:45.119 DEBUG:teuthology.orchestra.run.trial028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:32:45.176 DEBUG:teuthology.orchestra.run.trial134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:32:45.202 DEBUG:teuthology.orchestra.run.trial187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:32:45.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T01:32:45.240 DEBUG:teuthology.orchestra.run.trial028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:45.242 DEBUG:teuthology.orchestra.run.trial134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:45.244 DEBUG:teuthology.orchestra.run.trial187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:45.266 INFO:teuthology.orchestra.run.trial134.stdout:kernel.core_pattern = core 2026-02-13T01:32:45.291 INFO:teuthology.orchestra.run.trial187.stdout:kernel.core_pattern = core 2026-02-13T01:32:45.311 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = core 2026-02-13T01:32:45.338 DEBUG:teuthology.orchestra.run.trial028:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:45.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:45.375 DEBUG:teuthology.orchestra.run.trial134:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:45.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:45.394 DEBUG:teuthology.orchestra.run.trial187:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:45.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:45.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T01:32:45.422 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T01:32:45.422 DEBUG:teuthology.misc:Transferring archived files from trial028:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial028 2026-02-13T01:32:45.422 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:32:45.486 DEBUG:teuthology.misc:Transferring archived files from trial134:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial134 2026-02-13T01:32:45.486 DEBUG:teuthology.orchestra.run.trial134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:32:45.517 DEBUG:teuthology.misc:Transferring archived files from trial187:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47443/remote/trial187 2026-02-13T01:32:45.517 DEBUG:teuthology.orchestra.run.trial187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:32:45.552 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T01:32:45.552 DEBUG:teuthology.orchestra.run.trial028:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:32:45.557 DEBUG:teuthology.orchestra.run.trial134:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:32:45.560 DEBUG:teuthology.orchestra.run.trial187:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:32:45.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T01:32:45.614 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T01:32:45.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T01:32:45.629 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T01:32:45.629 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:32:45.635 DEBUG:teuthology.orchestra.run.trial134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:32:45.638 DEBUG:teuthology.orchestra.run.trial187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:32:45.653 INFO:teuthology.orchestra.run.trial134.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:32 /home/ubuntu/cephtest 2026-02-13T01:32:45.658 INFO:teuthology.orchestra.run.trial187.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:32 /home/ubuntu/cephtest 2026-02-13T01:32:45.669 INFO:teuthology.orchestra.run.trial028.stdout: 1048605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:32 /home/ubuntu/cephtest 2026-02-13T01:32:45.671 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T01:32:45.690 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T01:32:45.739 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} duration: 816.7122614383698 failure_reason: '"2026-02-13T01:23:35.918503+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T01:32:45.740 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:32:45.858 INFO:teuthology.run:FAIL